Xintong Yang

GPU floating-point non-determinism alone is enough to flip the sign of backpropagated gradients in differentiable physics engines, silently corrupting long-horizon robot optimization.

LLMs can maintain long-context performance even with aggressive KV-cache eviction by learning to predict token importance and compressing evicted tokens into a latent memory.