Search papers, labs, and topics across Lattice.
This paper introduces a real-time RGB-D perception pipeline designed to automate the operation of hydraulic impact hammers in mining, addressing the inefficiencies of teleoperated machines. By integrating image-based instance segmentation with geometric point cloud processing, the system generates feasible rock-breaking poses and a 3D representation of the workspace at approximately 10 Hz with a latency of 675 ms. Experimental results confirm the system's capability for responsive closed-loop behavior, making it suitable for autonomous operation in mining environments.
Real-time automation of hydraulic impact hammers could revolutionize mining efficiency by eliminating the need for teleoperation.
Impact hammers, also known as rock-breakers, are essential machines in mining operations, where they perform secondary reduction. In underground mining, these machines are typically teleoperated, limiting operational efficiency. This paper presents a real-time RGB-D perception pipeline as a step towards automating the operation of hydraulic impact hammers used in mining. The proposed system simultaneously generates operationally feasible rock-breaking poses and a robot-free 3D representation of the workspace. The proposed approach combines image-based instance segmentation with geometric point cloud processing, and operates on embedded hardware at approximately 10 Hz with a total latency of around 675 ms, enabling responsive closed-loop behavior when integrated with a control system. Experimental results in a representative scaled scenario demonstrate that the proposed system is suitable for real-time autonomous impact hammer operation.