Search papers, labs, and topics across Lattice.
This dissertation introduces a resource-rational, simulation-based framework for modeling visual attention as bounded-optimal control using Partially Observable Markov Decision Processes (POMDPs). It frames visual tasks like reading and multitasking as sequential decision-making problems under perceptual, memory, and time constraints. The framework reproduces classic empirical effects in reading and reading-while-walking tasks, explains comprehension-safety trade-offs, and generates novel predictions under varying conditions, providing a unified computational account of visual attention.
Visual attention, including eye movements and attention switching, can be modeled as the result of rational decision-making under perceptual, memory, and time constraints, offering a unified computational account.
Understanding how people allocate visual attention is central to Human-Computer Interaction (HCI), yet existing computational models of attention are often either descriptive, task-specific, or difficult to interpret. My dissertation develops a resource-rational, simulation-based framework for modeling visual attention as a sequential decision-making process under perceptual, memory, and time constraints. I formalize visual tasks, such as reading and multitasking, as bounded-optimal control problems using Partially Observable Markov Decision Processes, enabling eye-movement behaviors such as fixation and attention switching to emerge from rational adaptation rather than being hand-coded or purely data-driven. These models are instantiated in simulation environments spanning traditional text reading and reading-while-walking with smart glasses, where they reproduce classic empirical effects, explain observed trade-offs between comprehension and safety, and generate novel predictions under time pressure and interface variation. Collectively, this work contributes a unified computational account of visual attention, offering new tools for theory-driven and resource-efficient HCI design.
NUS