Grading-reference registry

Grading references

Where a verifier checkpoint rests on an external clause, the clause is listed here: the standard, its locator, and the rule the checkpoint applies. A reference is listed only once a frozen benchmark version uses it and the clause has been checked on the original source.

What a reference is

• One gradable action: a condition, a required value in a named artifact field, a polarity, the source clause with its check date, the check form, and whether a violation fails the task.
• Written against structured fields, never against wording or order, so that it can be graded by program and cannot be met by imitating a format.
• Uses the source's own terms and conditions. Where regional standards differ, the reference names both and the task must state the regional standard it is graded against.
• Tried against a conformant answer written differently from the drafter's own; a reference that would mark that answer wrong is rewritten.
• Only a reference checked on the original source can be a veto.

Which references a task tests is held on the closed side with the task. Publishing a reference does not publish an answer: a task asks whether the clause applies to an unseen case, when it is triggered, and what to log when information is missing. Schema: grading-reference.schema.json.