Search papers, labs, and topics across Lattice.
This paper introduces LO-FAR, a cost-aware local filtering method for ranking sparse features in industrial ad recommendation systems, addressing the high storage and computational costs associated with traditional embedding methods. By utilizing lightweight local estimators instead of GPU-bound retraining loops, LO-FAR achieves competitive performance in ranking features while significantly reducing computational time to approximately two CPU-hours on a large production dataset. The results demonstrate that LO-FAR can effectively maintain predictive performance while being a practical solution under tight resource constraints.
A simple local filter can outperform complex methods in feature ranking, achieving competitive predictive performance while slashing computational costs.
Industrial ad recommendation models rely heavily on sparse, high-cardinality ID-list features that encode user histories and contextual identifiers. Each is backed by a dedicated embedding table, so these features dominate storage, training, and serving cost and must be revisited as traffic and downstream models evolve. Therefore, sparse feature ranking is not just an offline modeling problem but also a recurrent systems decision limited by compute budgets and iteration cadence. We present Localized Feature Ranking (LO-FAR), a CPU-only, model-agnostic workflow that ranks each candidate feature from its stand-alone held-out predictive signal using lightweight local estimators rather than the GPU-bound retraining loops of permutation- and stochastic-gate-based methods. On a production dataset of more than one million logged interactions and 475 sparse ID-list features, LO-FAR completes ranking in approximately two CPU-hours and preserves downstream Normalized Entropy gains on CTR and CVR tasks that are competitive with shuffle-based importance, Binary Stochastic Neurons, and a coverage-based heuristic across budgets of 100--400 retained features. The contribution is a deployable workflow showing that, when cost and turnaround constraints are binding, a simple local filter can be a practical production choice over heavier interaction-aware alternatives.
Meta AI