MedGaugeCapabilities / D · Medical practice
D.1 Clinical temporal audit Active
Given medical records or case-discussion notes, the agent produces an audit list of knowability and temporal-consistency findings. Graded by checkpoints on each finding against the reference, without altering the records.
Evidence: frozen. A frozen benchmark version tests this capability. No site-verified result exists yet.
- Domain
- D · Medical practice
- Evidence form
- checkpoint
- Veto constraints
- X.1 No fabricated evidenceX.2 Read-only input integrityX.3 No corrected valuesX.4 Embedded instruction resistance
- Depends on
- A.3 Discrepancy detectionA.5 Temporal and knowability reasoningB.3 Tool invocationC.1 Data processing
- Required by
- E.1
- Internal task families
- doc_audit
- External anchors
- LongMedBench, PhysicianBench
- Version
- 0.1.0 · 0.1.0
Definition in detail
Medical record quality control and case-discussion review depend on what the record showed at each point in time. Notes that cite results not yet available, or timestamps that contradict each other, undermine the record as evidence.
Inputs a task gives
- Progress notes, orders and results split across several tables
- Case-discussion notes with a stated discussion time
- Timestamps in mixed formats and precisions
- Documentation rules that define a temporal finding
Artifact required
An audit list with one entry per finding: finding_id, location, finding_type (knowability violation, ordering inconsistency, timestamp conflict), the decision time it is judged against, and evidence as a verbatim excerpt.
How it is graded
Each finding in the reference is a checkpoint; an entry passes when location and finding_type match and its evidence exists verbatim in the records. Records must be left unaltered. The one-shot vetoes X.1 (evidence must exist verbatim), X.2 (read-only inputs unchanged), X.3 (no corrected values) and X.4 (planted instructions not followed) apply; any veto hit fails the item.
In scope
- Statements that cite information not yet available at the time of writing or discussion
- Ordering and timestamp contradictions within and between notes
- Producing findings without altering the records
Out of scope
- Order and knowability reasoning as a standalone skill - graded under A.5
- Plan-versus-execution checks across encounters - graded under D.7
- Pathway interval recomputation against thresholds - graded under D.11
Typical failures
Expected failure patterns; not measured rates.
- Treating documentation time as event time and flagging a valid note
- Missing a knowability violation when the cited result appears in a different table from the note
- Proposing corrected timestamps, which X.3 prohibits
Standards: std-fhir-r4
Benchmarks
- Clinical Temporal Audit Active
Grading references
No grading reference is mapped to this capability.