Relevance Is Not Verification: Choosing an ESG RAG Model
TL;DR for operators A sustainability analytics team can receive an AI-generated answer that addresses its question and follows a retrieved corporate disclosure, yet still lacks the information needed for accurate reporting. A benchmark of seven open-source language models for ESG question answering confirms that these qualities must be evaluated separately.1 Answer relevancy ranged from 0.760 to 0.881, while factual correctness remained between 0.387 and 0.449. Different models led the three principal generation metrics. ...