Search papers, labs, and topics across Lattice.
To resolve the tension between sample efficiency and cross-policy interference in real-time bidding A/B tests, the authors formulate the Bid-Aware Filter Family (BAFF), an approach that independently thresholds ad-ranking and bid-pricing disagreements in shared training logs. Standard shared-log training introduces pervasive evaluation bias through counterpart-model actions, while strict log-splitting starves models of critical training volume. Across offline simulations and a live demand-side platform deployment, tuned BAFF filters tracked the CPC and CTR of an interference-free reference policy significantly closer than either full log-sharing or log-splitting baselines.
Counterpart data sharing silently distorts production A/B tests, but selectively filtering bid and ranking divergences outperforms both naive log-sharing and data-starved log-splitting.
In online A/B tests for real-time bidding (RTB), control and treatment models are typically trained on a shared serving log that includes data generated by the counterpart model. This shared-log training biases each model's training data through two channels: the counterpart model may have selected a different ad from the ad-candidate pool (ad-ranking disagreement) and may have bid a different price (bid-pricing disagreement), potentially distorting the A/B test outcome. Log-splitting eliminates the bias but sacrifices training data; log-sharing retains all data but leaves the bias unaddressed. We formalize the Bid-Aware Filter Family (BAFF), a class of (k,l)-parameterized hard filters that controls tolerance to each channel independently, providing a structured search space between these two extremes. We further propose a three-stage online measurement protocol that enables evaluating data-sharing strategies by their deviation from an interference-free reference model in production. In offline simulation, a (k,l) sweep surfaces operating points with smaller deviation from the interference-free reference model than both log-sharing and log-splitting. In a live RTB deployment on a demand-side platform (DSP), filter-based variants preserve the reference model's business metrics (e.g., CPC, CTR) more closely than both baselines. The best operating point is setting-dependent, underscoring the practical value of the search space itself.
