Search papers, labs, and topics across Lattice.
This paper explores the concept of "cooperative observation" as a framework for enhancing personal AI systems, emphasizing the importance of a user's goals and constraints in shaping the AI's observational capabilities. The authors argue that merely increasing observation breadth does not improve assistance; instead, the quality of the AI's model is contingent on a dynamic feedback loop between the user and the system. A preliminary case study using the Organizm prototype over six months illustrates how user evaluation of AI actions influences the observation channel, impacting the system's effectiveness and trustworthiness.
A feedback loop of user evaluation and AI action can transform how personal AIs adapt and improve their observational capabilities.
A personal AI system needs a model of the user's goals, constraints, and ongoing commitments to plan and act on their behalf, and the quality of that model is bounded by what the system can observe. Broader observation does not by itself improve assistance because a bounded system must select and compress information for the task at hand. We argue that this observation bottleneck has a cooperative structure: the system builds a partial model of the user's changing life, the user evaluates its actions, and the user's consent and control shape what it can observe next. Useful and inspectable behavior can give users a reason to maintain or expand the observation channel, while failures can lead them to correct, narrow, revoke, or abandon it. We use the term cooperative observation for this feedback loop among usefulness, trust, and future access, and propose it as a framework for personal intelligence. We report a preliminary single-subject account from Organizm, a prototype used over six months, and outline evaluation directions for measuring how observation quality shapes personal AI.
