Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper investigates K-way energy probes in discriminative predictive coding networks (PCNs) as a potential source of richer metacognitive signals compared to softmax outputs. Through an approximate reduction, the authors demonstrate that with target-clamped cross-entropy energy training and effectively feedforward latent dynamics, the K-way energy margin largely decomposes into a monotone function of the log-softmax margin plus an uncorrelated residual. Empirical results across six conditions on CIFAR-10 confirm that the energy probe consistently tracks softmax from below, suggesting its limited advantage in this specific PCN formulation.
Despite appearances, a K-way energy probe in discriminative predictive coding networks offers little metacognitive advantage over softmax, as it largely reduces to a function of softmax under standard training.
We present this as a negative result with an explanatory mechanism, not as a formal upper bound. Predictive coding networks (PCNs) admit a K-way energy probe in which each candidate class is fixed as a target, inference is run to settling, and the per-hypothesis settled energies are compared. The probe appears to read a richer signal source than softmax, since the per-hypothesis energy depends on the entire generative chain. We argue this appearance is misleading under the standard Pinchetti-style discriminative PC formulation. We present an approximate reduction showing that with target-clamped CE-energy training and effectively-feedforward latent dynamics, the K-way energy margin decomposes into a monotone function of the log-softmax margin plus a residual that is not trained to correlate with correctness. The decomposition predicts that the structural probe should track softmax from below. We test this across six conditions on CIFAR-10: extended deterministic training, direct measurement of latent movement during inference, a post-hoc decoder fairness control on a backpropagation network, a matched-budget PC vs BP comparison, a five-point Langevin temperature sweep, and trajectory-integrated MCPC training. In every condition the probe sat below softmax. The gap was stable across training procedures within the discriminative PC family. Final-state and trajectory-integrated training produced probes whose AUROC_2 values differed by less than 10^-3 at deterministic evaluation. The empirical regime is small: single seed, 2.1M-parameter network, 1280 test images. We frame the result as a preprint inviting replication. We discuss conditions under which the decomposition does not apply (bidirectional PC, prospective configuration, generative PC, non-CE energy formulations) and directions for productive structural probing the analysis does not foreclose.