Some random thoughts.
Group Relative Policy Optimization (GRPO) is an efficient RL method used in DeepSeek-R1 to boost reasoning, using group-normalized rewards without a separate critic model.