GCPO: Diagnosing and Constraining Subspace Geometry in Rollout RL for LLMs
Researchers introduced GCPO (Geometrically Constrained Policy Optimization), a method that applies hard bilateral orthogonal projections to constrain updates in rollout reinforcement learning for largβ¦