Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
To reduce inference cost in non-generative decision models, this work evaluates whether decoupling candidate actions into cacheable independent encodings can preserve rule-following capabilities relative to full joint state-rule-candidate cross-attention. Decoupling action representations is crucial for scaling agentic retrieval and decision systems over large action menus, but risks severing the contextual alignment needed to enforce constraints. While targeted counterfactual supervision restores synthetic rule compliance, independent encodings fail to transfer to real-world rules, where joint scoring decisively retains an edge (0.861 vs. 0.500 accuracy).
Decoupling candidate actions into reusable cacheable embeddings yields a 5x inference speedup, but collapses real-world rule adherence by more than 35 percentage points compared to joint cross-attention.
Certo is a small non-generative decision model (Qwen3-4B): it scores candidate actions from their text and returns a probability, instead of generating an answer. The accurate design reads the state, the rules, and each candidate together (a joint scorer), so cost grows with the menu. Independent encoding lets each candidate be encoded once and reused across states (about 5x cheaper at 77 candidates), but separates state from candidate. We ask how much rule-sensitivity survives that move, and whether it can be trained back. Four experiments on Certo: (1) the tested conversion to cacheable scoring loses rule-sensitivity (recall@1 1.00 -> 0.24) while the joint scorer holds 1.00, and a shortlist+rerank rescue fails; (2) targeted counterfactual supervision restores strong performance on held-out synthetic rule tasks (paraphrase, counterfactual, composition; reproducible across seeds), though we do not isolate whether predictions depend on the supplied rule; (3) on real rules the added benefit is not established -- after fixing a truncation confound, the joint scorer wins significantly on the short tier (0.861 vs 0.500) and directionally on the hard tier (0.655 vs 0.483, n=29); (4) a matched cross-domain real-prose mixture did not help and reduced contract accuracy (-9.3, -16.2 points). A cacheable encoder can be made rule-sensitive on its training distribution, but transfer to unseen-source real rules is not established; the joint scorer keeps an edge at the cost of caching.