Search papers, labs, and topics across Lattice.
Shanghai Qiji Zhifeng Co., Ltd
1
0
2
Learned critics in RLHF can actually *increase* variance and hurt performance in sparse-reward settings, but a simple explained variance metric can tell you when to ditch the critic and get better results.
