Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The authors formalize the training and inference dynamics of Power Law Decoder Representation LLMs (PLDR-LLMs) by deriving exact finite work identities that track row-centered map energies under augmented AdamW optimization. This framework disambiguates absolute row collapse and operator stabilization from predictive accuracy, testing the validity of transferring training scaling laws directly to inference. Their analysis rejects common autonomous row-state closures and thermodynamic critical class assumptions, proving that row dynamics exhibit moving finite fluctuation regions that remain strictly dependent on the optimizer state and observation policy.
Transformer row representations fail to form an autonomous thermodynamic critical class during training, meaning popular physical scaling analogies collapse unless explicit optimizer memory and readout error budgets are accounted for.
This monograph develops a unified account of training and inference in Power Law Decoder Representation language models (PLDR-LLMs). Exact finite work identities decompose changes in the absolute energy of the row-centered learned map into parameter contributions, signed interactions, and numerical observation defects. Positive affine blocking retains restarts at the row-constant face, while the augmented AdamW state supplies the complete dynamical description. Predictive renormalization acts on the complete conditional training law for a single pass over distinct corpus target blocks, retaining optimizer memory, remaining data, schedule, and numerical policy. Autonomous reductions require closure; approximate reductions carry successor and emission errors. Finite-population covariance, matched physical clocks, matrix fluxes, and signed temporal energy connect row dynamics to model-wide observations. Absolute row collapse, relative row concentration, operator stabilization, and predictive accuracy are distinguished. Experiments reveal observer and optimizer dependence, reject the tested autonomous row-state candidates, and support finite conditional prediction and state-specific operator reduction. Independent single-pass families exhibit moving finite fluctuation regions without establishing a thermodynamic critical class. Conditional symmetry, head limits, covariance flows, and readout error budgets specify assumptions needed to transfer scaling laws to inference. The theory separates exact identities, conditional dynamical claims, and finite empirical findings, with proofs, selected formal checks, and compact numerical evidence.