arXivLLMs & Text

Utility-inspired Reward Transformations Improve Reinforcement Learning Training of Language Models

The paper introduces a new method for training large language models using reinforcement learning feedback, which makes models more beneficial and less harmful by adjusting sensitivity to reward values.