Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study conducts a comprehensive algorithm audit of LLM-assisted hotel selection, evaluating how various reputation signals influence recommendations across multiple models and personas. By employing a randomized choice-based conjoint analysis, the researchers quantify the impact of factors such as guest rating, price, and eco-certification on the likelihood of hotel selection. Key findings reveal that guest rating and price are the most significant determinants, while list position acts as a misleading influence, highlighting the need for transparency in AI-driven recommendation systems.
Guest ratings and price dominate hotel recommendations by LLMs, but eco-certification is overvalued, revealing critical biases in AI decision-making.
Travelers increasingly ask large language model (LLM) assistants which hotel to book, making these systems gatekeepers of property visibility -- yet what moves their recommendations is undocumented. We conduct a pre-specified algorithm audit using a randomized choice-based conjoint: across personas, prompt templates, and twelve open-weight and proprietary models, assistants choose among five hotels whose guest rating, review volume and recency, management response, chain affiliation, price, eco-certification, and list position are independently randomized. We estimate the average marginal component effect of each signal on the probability of recommendation. Guest rating and price dominate (a top rating raises selection by 31.6 percentage points; a high price lowers it by 30.0), reproducing human valence-and-price primacy but over-weighting eco-certification and ignoring management response. List position -- a content-free artifact -- shifts recommendations causally, worth about \$12 per night. Stated reasons track revealed weights imperfectly. The findings ground generative engine optimization and the accountability of AI infomediaries in causal evidence.