João Guilherme Alves Santos

Continued pretraining of ModernBERT for Portuguese yields state-of-the-art results in long-context retrieval and named entity recognition, challenging the notion that larger models are always superior.

LLMs show a striking 4.92-point performance gap on open-ended questions, revealing significant weaknesses in reasoning and image comprehension.