Search papers, labs, and topics across Lattice.
This study introduces a physics-guided spatiotemporal state space network, named WeldMamba, designed for real-time segmentation of weld pools in laser wire-feed welding. By leveraging historical grayscale images, welding parameters, and electrical signals, the model accurately predicts the future layout of key regions such as the keyhole, wire, and molten pool, achieving a mean Intersection over Union (mIoU) of 74.63% with a 500 ms lookahead. Key innovations include temporal state space modeling and motion-aware decoding, which enhance segmentation accuracy despite inherent delays in sensing and computation.
WeldMamba achieves a remarkable 74.63% mIoU in predicting weld pool dynamics, setting a new benchmark for real-time welding applications.
Real-time weld-pool perception is critical for closed-loop control in laser wire-feed welding, where sensing, computation, and actuator response introduce unavoidable delay. This paper presents a physics-guided spatiotemporal state space network for lookahead weld-pool segmentation. The model uses historical coaxial grayscale images, welding process parameters, and aligned wire-state electrical signals to predict the future semantic layout of three physically meaningful regions: keyhole, wire, and molten pool. It combines a visual encoder, process- and sensor-conditioned feature normalization, patch-level temporal state space modeling, horizon-conditioned latent prediction, dense future feature prediction, and a motion-aware mask decoder. Auxiliary signed-distance-function supervision, temporal consistency, feature distillation, and fine-grained keyhole losses further constrain the predicted geometry and local motion. Experiments on a 43-sequence laser welding dataset show that the proposed WeldMamba reaches 74.63\% mIoU at a 500 ms lookahead. Ablation studies further show that temporal history, patch-level state space modeling, and keyhole motion awareness are the main contributors to robust future segmentation.
