Search papers, labs, and topics across Lattice.
This paper introduces SensorPerch, an innovative active perception system that allows robots to autonomously detach and re-attach sensors in their environment, thereby overcoming the limitations of fixed or robot-mounted sensors. By utilizing a lightweight, wireless sensor platform and a viewpoint-selection framework, SensorPerch enables robots to dynamically create task-relevant viewpoints, independent of their location or existing infrastructure. The results demonstrate that SensorPerch significantly enhances object-state detection and policy-specific viewpoint construction, achieving performance comparable to optimal configurations while extending the effective sensing range of robots.
Robots can now autonomously reposition sensors to achieve optimal perception, dramatically enhancing their operational flexibility and effectiveness.
Existing robotic perception is constrained by sensors that are either robot-mounted or permanently fixed in the environment, locking perception to a limited set of viewpoints. Yet as robots perform increasingly diverse tasks, the most informative viewpoint shifts from one task to the next-often somewhere onboard sensor and static infrastructure can not readily satisfy. To address this gap, we propose SensorPerch, a novel realization of active perception that decouples sensing from both the robot embodiment and the environment by treating sensors as independent physical entities that the robot can autonomously detach and re-attach within the environment. SensorPerch presents one realization of this paradigm: a lightweight, wireless, reconfigurable sensor platform that can perch on diverse surfaces, paired with a viewpoint-selection framework that determines task-optimal sensor placements. Together, these enable robots to construct task-relevant viewpoints on demand, independent of the robot's current position and available fixed infrastructure. We demonstrate the paradigm on two task classes: (i) object-coupled perception, where SensorPerch enables persistent object-state detection beyond the robot's current position, achieving successful event detection even when the robot is not nearby; and (ii) policy-coupled perception, where SensorPerch allows robots to construct diverse, policy-specific viewpoints for various policies, achieving success rates comparable to those obtained using oracle viewpoints.
