LLM Evaluation Pipeline Checklist Form
Track and validate an LLM evaluation pipeline with checklist steps, scoring, and follow-up actions.
Evaluation Setup
Evaluation name or run ID
*
Model name or version under test
*
Evaluation date
*
 -
Month
 -
Day
Year
2 digit month, 2 digit day, 4 digit year
Date
Evaluator or team name
*
Evaluation environment or stage
*
Local
Staging
Production
Other
Pipeline Checklist
Dataset prepared
Yes
Prompts finalized
Yes
Baseline established
Yes
Metrics defined
Yes
Test run executed
Yes
Outputs reviewed
Yes
Failures logged
Yes
Results approved for release
Yes
Evaluation Criteria
Evaluation Criteria Ratings
*
Rows
1 - Poor
2 - Fair
3 - Good
4 - Very Good
5 - Excellent
Correctness
1
2
3
4
5
Faithfulness
6
7
8
9
10
Toxicity / Safety
11
12
13
14
15
Latency
16
17
18
19
20
Cost Efficiency
21
22
23
24
25
Robustness
26
27
28
29
30
Overall Evaluation Score
*
Needs major improvement
1
2
3
4
5
6
7
8
9
Outstanding
10
1 is Needs major improvement, 10 is Outstanding
Notes and Observations
Issues and Follow-Up
Issues Found
*
Severity
*
Low - minor impact, easy to resolve
Medium - needs attention before next review
High - blocks progress or affects evaluation quality
Recommended Next Step or Owner
Additional Notes
Submit
Should be Empty: