Search papers, labs, and topics across Lattice.
This paper introduces FORGE-plus, a two-layer framework that utilizes a frozen large language model (LLM) to assign force ceilings for contact-rich assembly tasks and select recovery maneuvers based on textual force signatures. The framework successfully manages fragile object handling, achieving a 100% success rate in evaluation episodes without breakage, while effectively resolving 40% to 64% of insertion failures under slip conditions. These results highlight the potential of integrating LLMs into robotic assembly processes to enhance safety and reliability in delicate operations.
A frozen LLM can effectively guide robotic assembly by setting force limits and selecting recovery actions, achieving flawless performance with fragile objects.
Force-conditioned reinforcement learning (RL) enables tight-clearance assembly under a commanded force ceiling, but practical deployment requires determining an appropriate force limit for each object and recovering from insertion failures without exceeding it. We present a two-layer framework in which a frozen, text-only large language model (LLM) assigns a per-object force ceiling before execution and selects recovery maneuvers from a fixed action menu using compact textual force signatures. The LLM never controls force directly: a low-level controller enforces the force ceiling, the recovery policy cannot increase it, and the hidden breaking-force threshold is known only to the evaluator. We evaluate the framework on fragile bottle placement and 0.4 mm diametral-clearance gear insertion using two grippers (Robotiq 2F-140 and Franka Panda hand). A single policy passes 256/256 evaluation episodes on both fragile and robust objects without breakage, correctly predicts release timing, and completes a full table-pick-and-insert pipeline with a mean peak force of 5.4 N. Under injected in-grip slip, the force-signature recovery strategy resolves 40% and 64% of failures on the two grippers, whereas a press-harder baseline is either ineffective or causes frequent breakage. We also report negative results, including the failure of PPO to solve the task under strict force constraints and unsuccessful learned release strategies. All experiments are conducted in rigid-body simulation with hidden force-threshold breakage; no sim-to-real claim is made.