Kanishka Tyagi

Self Machines Inc San Francisco

Papers on Lattice

Total citations

Topics

Research focus

RLHF & Preference Learning (1)Training Efficiency & Optimization (1)

Frequent co-authors

Chinmay Rane (1)Michael Manry (1)

Papers (1)

Jul 20, 2026

Quantiphi IncJul 20, 2026·also Self Machines Inc San Francisco, UT Austin

OR Else: A Differentiable Trust Region for Policy Optimization

PPO-OR achieves a significant reward improvement over traditional PPO-clip, highlighting the potential of smooth saturation methods in policy optimization.

Chinmay Rane, Kanishka Tyagi, Michael Manry

RLHF & Preference Learning Training Efficiency & Optimization

Kanishka Tyagi

Research focus

Frequent co-authors

Papers (1)

Search

Kanishka Tyagi

Research focus

Frequent co-authors

Papers (1)