LLM Output Consistency Evaluation Form
Evaluate how consistent an LLM’s outputs are across repeated prompts or variants using structured assessment criteria.
Evaluator Name
First Name
Last Name
Evaluation Date
*
 -
Month
 -
Day
Year
2 digit month, 2 digit day, 4 digit year
Date
Prompt or Variant Evaluated
*
How consistent were the LLM’s outputs across repeated prompts or variants?
*
Not consistent
1
2
3
4
Highly consistent
5
1 is Not consistent, 5 is Highly consistent
Did you observe any significant variations in meaning or tone?
*
No significant variation
Minor variation
Major variation
How clear and understandable were the outputs?
*
Not clear
1
2
3
4
Very clear
5
1 is Not clear, 5 is Very clear
How similar were the outputs in structure and style?
*
Very different
1
2
3
4
Nearly identical
5
1 is Very different, 5 is Nearly identical
Which best describes the level of factual consistency in the outputs?
*
All outputs factually consistent
Some minor factual inconsistencies
Major factual inconsistencies
Additional Comments
Submit Evaluation
Should be Empty: