Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a low-energy underwater monitoring architecture that integrates continuous edge sensing with selective local processing to address the challenges of energy constraints and poor connectivity in marine environments. Utilizing a hierarchical master-satellite design, the system employs ultra-low-power microcontrollers for ongoing monitoring and activates a high-performance NVIDIA Jetson Orin NX only for specific tasks, optimizing energy use. The architecture effectively combines multimodal data processing, species identification, and automated reporting, demonstrating its capability to produce structured knowledge while minimizing communication overhead through efficient data compression.
By merging ultra-low-power sensing with local multimodal intelligence, this system enables underwater monitoring stations to deliver actionable insights without draining resources.
Marine life monitoring is limited by strict energy constraints, poor underwater connectivity, and the high cost of transmitting raw multimodal data from remote deployments. This paper proposes a low-consumption underwater monitoring architecture that combines always-on edge sensing with selective high-performance local reasoning. The system follows a hierarchical master--satellite design in which ultra-low-power MAX78000/MAX78002 microcontrollers continuously monitor visual and acoustic signals, while an NVIDIA Jetson Orin NX is activated only for scheduled processing, event-driven analysis, or researcher interaction. Once active, the Jetson executes a fully local multimodal pipeline for data ingestion, visual target extraction, embedding-based indexing, species identification, retrieval-augmented reasoning, and automated reporting. BioCLIP/OpenCLIP embeddings are used to organize mission data, marine taxonomic references, scientific documents, and operational metadata in local ChromaDB collections. A dedicated identification layer combines visual similarity search, centroid-based classification, and supervised classifiers to support adaptive species recognition. A LangChain-based multi-agent framework coordinates query routing, structured analysis, energy management, hardware reconfiguration, and report generation. The architecture is evaluated through visual and acoustic monitoring case studies. The proposed system bridges ultra-low-power continuous sensing with local multimodal intelligence, enabling underwater stations to produce structured, researcher-ready knowledge while compressing local data for flexible acoustic, optical, or satellite transmission, minimizing both energy use and communication overhead.