Search papers, labs, and topics across Lattice.
This paper introduces a diagnostic methodology for developing industry-scale Audio-Visual-Language Models (AVLM) tailored for video and live-streaming moderation, addressing the limitations of generic pretrained models. By categorizing model failures into a taxonomy of observable signatures and linking them to specific interventions, the authors provide a systematic approach to improving model performance beyond heuristic trial-and-error. The methodology was successfully instantiated in a large-scale AVLM system that operates effectively across over 100 regions, handling diverse and ambiguous content from global platform traffic.
A systematic diagnostic approach reveals that targeted interventions can significantly enhance AVLM performance in video moderation, moving beyond mere trial-and-error fixes.
Industry-scale video and live-streaming moderation imposes requirements that are difficult to satisfy with generic pretrained public models or external APIs, including adaptation to platform-specific data distributions, policy-specific objectives, and product-level safety constraints. As a result, platforms must undertake internal model development, naturally turning to shared public research for guidance. However, existing multimodal foundation-model studies primarily report architectures, training recipes, data scaling strategies, and benchmark results, but provide less systematic guidance on how failures should be localized and translated into targeted model-development interventions. Interventions are essential because deployment failures are rarely self-explanatory. Similar failures can originate from different causes. Without targeted interventions, improvement reduces to heuristic trial-and-error, where benchmark improvements are weakly attributable, and failures are difficult to trace to their underlying causes. To address this gap, we present a diagnostic methodology for industry-scale Audio-Visual-Language Models AVLM development. The methodology maps model failures into a taxonomy of observable failure signatures and links each class of failure to an intervention space. We instantiate this methodology across the development and alignment lifecycle of an AVLM foundation model for a large-scale video and live-streaming platform. The resulting system supports over 100 regions and is designed for noisy, ambiguous, and highly diverse content drawn from global platform traffic.
