Search papers, labs, and topics across Lattice.
This paper introduces two games designed to educate users on the inner workings of Large Language Models (LLMs). "Learn Like an LLM" illustrates the sequence prediction training process, while "Tag-Team Text Generation" demonstrates the token-by-token generation process influenced by probabilities and randomness. The authors aim to improve AI literacy through engaging, game-based learning experiences.
Demystifying LLMs for the masses might be as simple as turning their mechanics into a game.
While artificial intelligence (AI) technology is becoming increasingly popular, its underlying mechanisms tend to remain opaque to most people. To address this gap, the field of AI literacy aims to develop various resources to teach people how AI systems function. Here we contribute to this line of work by proposing two games that demonstrate principles behind how large language models (LLMs) work and use data. The first game, Learn Like an LLM, aims to convey that LLMs are trained to predict sequences of text based on a particular dataset. The second game, Tag-Team Text Generation, focuses on teaching that LLMs generate text one word at a time, using both predicted probabilities of the data and randomness. While the games proposed are still in early stages and would benefit greatly from further discussion, we hope they can contribute to using game-based learning to teach about complex AI systems like LLMs.
MIT CSAIL