Search papers, labs, and topics across Lattice.
MazzikaAI addresses the limitations of generative music models in Arabic maqam music by creating a real-time performance-to-prompt compiler that utilizes natural language to control a streaming text-to-music model. The system integrates live MIDI, gesture, and inferred harmony into dynamic text prompts, allowing it to adapt to microtonal structures without the need for model finetuning. Empirical evaluations show that MazzikaAI significantly enhances the generation of off-grid quartertone content, demonstrating its potential for culturally inclusive music creation and education.
MazzikaAI transforms real-time Arabic maqam accompaniment by seamlessly integrating expert musical knowledge with generative AI, achieving unprecedented responsiveness and microtonal fidelity.
Arabic maqam music microtonal, modal, and built on ornamented call and response is among the traditions most underserved by generative music models, whose training frameworks remain predominantly Western and equaltempered. Real time accompaniment sharpens this gap: an AI partner must listen, adapt dynamically, and respect idiomatic microtonal structures. Streaming text to music models provide strong generative capabilities but lack precise control interfaces. We present MazzikaAI, a knowledge based system that uses natural language as the actuator of a realtime control loop. By compiling live MIDI, gesture, and inferred harmony into continuously updated text prompts, MazzikaAI steers an unmodified streaming generator, Google Lyria RealTime, without requiring model finetuning. The system embeds expert knowledge of six core maqamat, characteristic ornaments, and ensemble dynamics, maintaining realtime responsiveness with subsecond keytoaudibleupdate latency. Empirical evaluations demonstrate that dynamic prompt compilation reliably grounds generation in microtonal scales, significantly increasing offgrid quartertone content over baseline generation. Beyond its core implementation, MazzikaAI illustrates how deterministic knowledgebased rules can effectively bridge expert, nonWestern musical traditions and unfinetuned foundation models. This architecture establishes a scalable paradigm for realtime humanAI cocreation, offering a generalizable blueprint for interactive accompaniment, adaptive music education, and culturally inclusive generative audio across diverse global idioms.
