Why PPO clips the probability ratio
mediummcq
Practice question
PPO's surrogate objective clips the ratio r = π_new(a|s)/π_old(a|s). What does the clipping accomplish?
Practice question
PPO's surrogate objective clips the ratio r = π_new(a|s)/π_old(a|s). What does the clipping accomplish?