Field | Description |
---|---|
question | The question asked to the RAG system. |
answer | The answer provided by the assistant being evaluated. |
ground_truth_answer | The expected answer. |
0
to 1
are returned for the following metrics:
Metric | Description |
---|---|
correctness | Correctness of the RAG system’s answer compared to the ground truth answer. |
completeness | Completeness of the RAG system’s answer compared to the ground truth answer. |
alignment | A combined score of the correctness and completeness scores. |
Status | Description |
---|---|
entailed | The fact is supported by the ground truth answer. |
contradicted | The fact contradicts the ground truth answer. |
neutral | The fact is neither supported nor contradicted by the ground truth answer. |