Search papers, labs, and topics across Lattice.
This paper investigates the use of large language models (LLMs) to generate modifications for neural networks by leveraging a stronger source model from the same family, addressing the issue of invalid or harmful unrestricted generation. The authors introduce a source-guided candidate-generation protocol that evaluates the validity and accuracy of generated candidates, ensuring that only improvements to a weak target model are selected. Results show significant accuracy gains on CIFAR-10 and SVHN datasets, with source-guided candidates outperforming non-source candidates by substantial margins, confirming the effectiveness of adaptation over mere copying of source recipes.
Source-guided neural network modifications can boost model accuracy by over 56% compared to traditional methods, demonstrating the power of LLM adaptation in model improvement.
Large language models (LLMs) can generate neural-network modifications, but unrestricted generation is often invalid or harmful. This paper studies a narrower setting: improving a weak target model using a stronger same-family source model from a neural-network database. We propose a source-guided candidate-generation protocol with non-source controls, source-conditioned candidates, and a no-LLM hp_copy ablation under equal evaluation budgets. The protocol reports validity separately from accuracy and selects the best valid candidate only when it improves the target. On CIFAR-10, the strongest source-guided candidate reaches 0.5049 accuracy versus 0.2398 for the best non-source candidate, a +0.2651 advantage, while improving a weak target originally at 0.1254; a five-epoch check preserves the gain at 0.7686 versus 0.4839. On SVHN AlexNet with DeepSeek-Coder-6.7B, source-guided transfer reaches 0.7880 versus 0.2254, a +0.5626 advantage; a fresh repeat reaches 0.8069 versus 0.2509, a +0.5560 advantage. Direct source-recipe copy produces 0.1959 on SVHN AlexNet, matching the original target, while hp_transfer reaches 0.7880, showing that the LLM adapts rather than copies the source recipe. Family-level analysis shows the clearest positive signals for AlexNet, with 6/8 wins across SVHN, Imagenette, and CelebA-Gender, and alt_nn1, with 8/10 wins on CIFAR-10.
