Skip redundant forward pass for on-policy vLLM importance sampling#5413

GJ98 wants to merge 3 commits intohuggingface:mainhuggingface/trl:mainfrom

GJ98:feat/grpo-skip-no-grad-forward-on-policyGJ98/trl:feat/grpo-skip-no-grad-forward-on-policyCopy head branch name to clipboard