Search papers, labs, and topics across Lattice.
This study investigates the impact of context selection and prompting strategies on Bengali news headline generation using large language models like Gemini-2.0-Flash, Llama-3.3-70B, and GPT-4o. The research reveals that providing full articles does not enhance performance; instead, selected lead paragraphs can improve headline quality, particularly when employing Bengali Native Prompting (BNaP) and Cross-Lingual Prompting (XLP) with context-enriched templates. Key findings indicate that while few-shot prompting significantly benefits Gemini, Llama's performance is less sensitive to additional examples, underscoring the importance of context relevance and prompt design over input length.
Selected lead paragraphs can outperform full articles in generating high-quality Bengali news headlines, challenging conventional input length assumptions.
Large language models (LLMs) have shown strong performance in text generation tasks, yet their effectiveness on headline generation remains sensitive to how input context is selected and presented. In this work, we investigate Bengali news headline generation as a document-level generation task that requires effective selection and presentation of salient contextual information from long-form articles. Using Gemini-2.0-Flash, Llama-3.3-70B, and GPT-4o, we systematically study the effects of context selection, prompting strategies, and in-context learning (i.e., few-shot) on the quality of headline generation. Our experiments show that providing the full article does not necessarily improve performance; instead, using selected lead paragraphs of the article can maintain, and in some cases improve, headline generation quality. We further compare Bengali Native Prompting (BNaP) and Cross-Lingual Prompting (XLP), and examine how each interacts with context-enriched prompt templates incorporating auxiliary contextual cues. Results demonstrate that prompting strategies substantially influence generation quality: XLP often yields stronger performance, particularly when combined with contextual enrichment, but its benefits are model-dependent. Additionally, few-shot prompting substantially improves Gemini, with most of the gain obtained from a single demonstration, whereas Llama shows limited benefit from additional examples. Overall, our findings highlight that effective Bengali news headline generation depends more on context relevance and prompt design than on increasing input length, offering practical insights for multilingual and low-resource LLM applications.
