Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces Ranking Companion, a visual analytics tool designed to enhance item-based ranking by integrating model-driven active learning with human-driven item selection methods. The approach allows users to externalize their preferences through a combination of six complementary item-selection methods, facilitating a more flexible and controlled ranking process. User studies revealed that this hybrid method improves perceived ranking quality across multiple dimensions, including accuracy and user satisfaction, while providing interpretable results through explanations.
Users can achieve higher satisfaction and better ranking quality by leveraging a hybrid approach that combines multiple item-selection methods in personalized ranking tasks.
Personalizing item ranking creation is a challenging task, especially when users lack knowledge of data attributes or the ability to express and formalize their attribute preferences. Item-based ranking creation is an approach allowing users to directly externalize preferences through known-item judgments rather than attribute-based scoring. However, a core challenge of item-based ranking is identifying and selecting representative candidate items for externalizing preferences. Existing approaches rely on singular item-selection methods, limiting flexibility and user control. To address this challenge, we present Ranking Companion, a visual analytics approach for item-based ranking that combines model-driven active learning with human-driven item-selection methods. By drawing from six complementary item-selection methods, users can externalize listwise preferences based on selected candidate items, while an iterative machine learning process with a ranking model calculates ranking results, presented to users alongside explanations for interpretation. We evaluated Ranking Companion in a formative user study with 10 participants, in which participants used each item-selection method across three iterations, revealing tradeoffs in perceived ranking quality across accuracy, diversity, novelty, transparency, control, and satisfaction. Ranking Companion contributes a unified interactive item selection space and provides preliminary empirical guidance toward the hybrid use of multiple complementary item-selection methods in personalized item-based ranking creation.