3 stories tagged Generalization
A new study explores whether reinforcement learning (RL) on beneficial behavior can help AI systems generalize alignment beyond their training data, addressing risks like reward hacking and deception in high-stakes settings.
Researchers developed a new type of AI model that can reason about unseen combinations of objects by combining causal and relational reasoning. This breakthrough could help AI systems generalize better to new situations.
Researchers challenge the notion that supervised finetuning memorizes while reinforcement learning generalizes. They find that cross-domain generalization is conditional, influenced by optimization, data, and model capability. This challenges prevailing narratives in LLM post-training.