Wellmet | Annotation review checklist

Task and intended use:
Label schema and version:
Rubric owner and version:
Positive examples:
Boundary cases:
Ambiguity and abstention policy:
Calibration batch:
Reference labels and who approved them:
Independent review method:
Agreement metric and limitations:
Sample selection and size:
Acceptance threshold and rationale:
Correction and adjudication process:
Approved tools and access:

Delivery requirements
Stable record identifiers:
Original input retained:
Final labels:
Rubric version:
Review state:
Reasons for changes:
Unresolved exceptions:
Schema validation results:
Quality-review results and limitations:

Planning worksheet. Agreement, schema validity, and real-world accuracy are different measures.