Search papers, labs, and topics across Lattice.
This paper introduces JourneyFormer, a sequence modeling solution specifically designed for improving search ranking in Airbnb's complex guest journey context. The authors address the challenges of sparse booking labels and long, exploratory guest sequences by implementing tailored design decisions in data handling and model architecture. The deployment of JourneyFormer resulted in enhanced offline ranking metrics and significant improvements in key business outcomes, validated through rigorous online A/B testing.
JourneyFormer transforms Airbnb's search ranking by effectively modeling complex guest journeys, leading to substantial gains in business performance.
Sequence modeling has become increasingly popular in recommendation and ranking algorithms, owing to its capacity to model users' historical behaviors and infer user intentions. Despite its theoretical simplicity, the practical deployment of a sequence model in production is non-trivial due to complexity of the sequence and sparse labels. For example, in Airbnb, guest sequences are often long, exploratory and complex, and we focus on booking labels, which are sparse. As such, we are often required to make various design decisions regarding data and modeling to strike a balance between effectiveness and scalability. This work delved into these production challenges and deployed JourneyFormer, a sequence modeling solution for search ranking at Airbnb. We detail crucial design considerations, covering aspects such as guest event selection, ID embeddings, model architecture, and label attribution. Additionally, we describe several tailored strategies to accelerate model training and inference. JourneyFormer has been successfully deployed within Airbnb's production, where its effectiveness and impact have been evidenced not only by improved offline ranking metrics but also by significant gains in key business metrics through online A/B testing across 2 production surfaces.
