Search papers, labs, and topics across Lattice.
This paper introduces a predictive-adaptive framework using a Factorized Dynamics Transformer (FDT) for real-time residual modeling and compensation in Autonomous Aerial Manipulators (AAMs). The FDT architecture explicitly factorizes cross-variable coupling and multi-scale temporal effects by treating physical variables as independent tokens and separating short-horizon inertial dependencies from long-horizon aerodynamic effects. A Latent Residual Adapter (LRA) then performs rapid linear adaptation in the latent space to address deployment-time distribution shifts.
Aerial manipulators can achieve superior closed-loop tracking precision and disturbance attenuation in real-world scenarios with unseen payloads by using a novel Factorized Dynamics Transformer (FDT) architecture coupled with a Latent Residual Adapter (LRA) for real-time residual modeling and compensation.
Autonomous Aerial Manipulators (AAMs) are inherently coupled, nonlinear systems that exhibit nonstationary and multiscale residual dynamics, particularly during manipulator reconfiguration and abrupt payload variations. Conventional analytical dynamic models rely on fixed parametric structures, while static data-driven model assume stationary dynamics and degrade under configuration changes and payload variations. Moreover, existing learning architectures do not explicitly factorize cross-variable coupling and multi-scale temporal effects, conflating instantaneous inertial dynamics with long-horizon regime evolution. We propose a predictive-adaptive framework for real-time residual modeling and compensation in AAMs. The core of this framework is the Factorized Dynamics Transformer (FDT), which treats physical variables as independent tokens. This design enables explicit cross-variable attention while structurally separating short-horizon inertial dependencies from long-horizon aerodynamic effects. To address deployment-time distribution shifts, a Latent Residual Adapter (LRA) performs rapid linear adaptation in the latent space via Recursive Least Squares, preserving the offline nonlinear representation without prohibitive computational overhead. The adapted residual forecast is directly integrated into a residual-compensated adaptive controller. Real-world experiments on an aerial manipulator subjected to unseen payloads demonstrate higher prediction fidelity, accelerated disturbance attenuation, and superior closed-loop tracking precision compared to state-of-the-art learning baselines, all while maintaining strict real-time feasibility.