Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
HeuFouFT is a task-guided framework that employs metaheuristic optimization (GA-SA, PSO, CS) to intelligently select trainable frequency coordinates in Fourier fine-tuning, moving beyond fixed, task-agnostic sampling strategies. By using lightweight probes and a Random Forest filter to guide the search, HeuFouFT effectively allocates a limited spectral budget to maximize downstream performance. Experiments on E2E with GPT-2-Medium demonstrate that HeuFouFT variants outperform existing FourierFT schemes and LoRA, with PSO achieving superior results on most metrics while using significantly fewer trainable parameters.
Metaheuristic search for Fourier fine-tuning coordinates unlocks substantial parameter efficiency gains, outperforming LoRA and fixed sampling strategies.
We introduce Heuristic-Guided Fourier Fine-Tuning (HeuFouFT), a task-guided framework for selecting trainable frequency coordinates in Fourier fine-tuning. Existing uniform and Gaussian band-pass schemes allocate a limited spectral budget through fixed, task-agnostic rules. HeuFouFT instead searches for coordinates using downstream performance. A coarse intensity map from lightweight block-level probes initializes three metaheuristic optimizers: Genetic Algorithm with Simulated Annealing (GA-SA), Particle Swarm Optimization (PSO), and Cuckoo Search (CS). During search, a Random Forest filters each population so that only the top 30% of candidates proceed to proxy fine-tuning. On E2E with GPT-2-Medium, all three variants outperform random-uniform FourierFT, Gaussian band-pass FourierFT, and LoRA across five metrics. PSO further outperforms LoCA, the best-performing baseline, on four metrics while using 37.6% fewer trainable spectral coefficients. Once coordinates are selected, HeuFouFT requires only 15--18% FLOPs of Full FT. These results show that task-guided search allocates limited spectral capacity more effectively than fixed sampling. Our code is publicly available.