Evaluation Awareness Beyond English: Do LLMs Act Differently When Tested in Indic Languages?
Large language models (LLMs) can often tell when they are being tested. This ability, known as evaluation awareness, can lead models to act more cautiously during safety evaluations than in real use. Existing work has studied evaluation awareness almost entirely in English, although models serve users in many languages. Indic languages are spoken by over a billion people, yet evaluation awareness…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
