Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a novel approach to robotic ultrasound scanning that emphasizes task-relevant feature-dynamics fidelity (TR-FDF) for effective zero-shot sim-to-real transfer. By analyzing the impact of TR-FDF mismatch on closed-loop performance, the authors developed a specialized simulator that integrates a shared structural intermediate domain and trajectory-level noise. The results are striking, with a policy trained solely in simulation achieving a 97.5% success rate in zero-shot deployments across multiple target planes, demonstrating the critical role of TR-FDF in enhancing transferability from simulation to real-world applications.
Achieving a 97.5% success rate in zero-shot robotic ultrasound scanning shows that task-relevant feature dynamics can outpace traditional simulation realism.
Robotic ultrasound policies operating directly on B-mode images require extensive interaction data, whereas real-robot data collection is costly and safety-constrained. Simulation provides a scalable alternative, but zero-shot transfer depends not only on single-frame realism but also on whether simulated observations reproduce task-relevant feature changes induced by probe motion. We term this cross-domain consistency task-relevant feature-dynamics fidelity (TR-FDF). Under local regularity assumptions, our contraction analysis shows that greater sensitivity of TR-FDF mismatch to probe motion reduces the effective closed-loop contraction margin, whereas motion-independent errors primarily enlarge the residual error bound. Guided by this analysis, we develop a TR-FDF-oriented ultrasound simulator that combines a shared structural intermediate domain, trajectory-level fixed noise, and few-step conditional flow generation. In phantom experiments, a policy trained exclusively in simulation succeeded in 390 of 400 zero-shot deployments across four target planes. The simulator achieved an FID of 29.66 and generated observations at 67.1 Hz. Controlled interventions, ablations, and baseline comparisons showed that TR-FDF sensitivity complements single-frame realism in predicting zero-shot transfer performance.