Practice scoring and validation
Understand what your practice record measures and what evidence is still needed.
What you can record
After finishing a station, mark the actions actually demonstrated and select a global performance rating. Use an independent observer when possible. Optional records are saved only on this device, with anonymous learner, rater and attempt codes. Export them for private analysis.
What a result means
Checklist totals describe completion, and critical omissions remain visible separately. Global ratings describe organization, clinical judgment, safety and communication. An 80% checklist total is not an established passing standard.
How evidence will be evaluated
| Question | Evidence required | Current position |
|---|---|---|
| Is the content appropriate? | Independent clinician review and defensible objective/source mapping | Pending sign-off |
| Are items useful? | Observed item performance, uncertainty and corrected item-total analysis | Pilot required |
| Do observers agree? | Independent ratings of the same attempts and calibration review | Paired ratings required |
| Are scores reproducible across stations? | Designed case/rater sampling and examination-level reliability analysis | Not established |
| Does a threshold indicate readiness? | Expert standard-setting, external outcome evidence and consequence/fairness review | No readiness threshold established |
Next steps for the review team
- Approve the station content, references and observable scoring anchors.
- Train observers and standardized participants with calibration performances.
- Collect complete observed attempts with consent and anonymous codes.
- Analyze item patterns and rater disagreement without pooling different case versions.
- Revise and repeat before making validated scoring or pass-prediction claims.
The downloadable website package includes an offline pilot analysis script and protocol. Never upload learner exports into the public website directory.
Official MCC scoring information. BoardQBank checklists are independent practice tools, not the MCC scoring algorithm.
