LEMUR: Learning to Align with Multi-Objective Reinforcement Learning from Preference Feedback
Reinforcement Learning (RL) systems are typically trained using a single, well-specified scalar reward function. However, real-world decision-making tasks often involve multiple, competing objectives, such as performance versus efficiency, where ground-truth reward functions are difficult to specify or inaccessible. While Multi-Objective RL (MORL) addresses such trade-offs by modeling rewards as…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.