AI Researchers Solve LLM Reasoning Problem With Outcome-Guided Process Rewards

Researchers introduced PROGRS, a framework that improves mathematical reasoning in large language models by using process reward models (PRMs) while keeping final answer correctness dominant. The method treats intermediate step scores as relative preferences rather than absolute targets, reducing reward hacking and improving performance across multiple benchmark tests with fewer computational rollouts.