Sunny Panchal

Local perception in vision models could be the key to unlocking robust generalization across complex tasks, challenging the dominance of global approaches.

Transformers struggle with state tracking even in-distribution, requiring far more data than RNNs as sequence length grows, and failing to generalize learned mechanisms across sequence lengths.