5 stories tagged Feedback
Researchers from the University of Washington and Google Research introduced CriticGen, a fine-grained evaluation framework that generates specific, actionable feedback to improve AI model responses, unlike traditional coarse-grained methods.
A new arXiv paper introduces S2T-RLHF, a method that uses hierarchical credit assignment to stabilize reinforcement learning from human feedback (RLHF). By breaking sequence-level rewards into finer token-level supervision, the approach reduces training instability and helps AI models learn human preferences more accurately, leading to more reliable AI assistants and tools.
Scientists studied how natural-language feedback helps AI models improve. They found that feedback can lead to real gains, but only under specific conditions. The research highlights the importance of distinguishing between true learning and other factors that might mimic improvement.
Researchers propose PolicyBank, a framework where LLM agents refine their policy interpretations through interaction and feedback. This could reduce gaps between natural language specifications and actual agent behavior.
Researchers developed GoodPoint, an AI system to generate actionable feedback for scientific papers. The tool focuses on validity and author action, aiming to augment rather than replace human oversight in research.