To interpret IOA thresholds without a universal cutoff, connect the review rule to the measurement method, denominator, prevalence, disagreement type, sample coverage, and clinical risk. Predeclare the rule and the action it triggers. A pooled percentage can conceal one weak condition or a safety-relevant mismatch. IOA supports a measurement review; it never replaces validity, integrity, outcome, or client-experience evidence.

Name the decision

State which clinical or measurement action the rule informs and who has authority to make it.

Choose the method first

A cutoff has different meaning for total count, exact interval, trial, occurrence-focused, or event-duration agreement.

Add exception triggers

Flag safety, access, assent, medication, event-matching, or missing-exposure disagreements regardless of the pooled percentage.

Define the response

Specify whether the result leads to calibration, resampling, data hold, definition revision, referral, or broader review.

Write a decision rule with four parts

A useful rule names the unit and calculation, minimum sample coverage, review threshold, and required action. It also identifies exception triggers that bypass the numeric threshold. Store the rule version and approval date with the worksheet so a later reviewer can tell which standard governed the sample.

Match the response to the decision's consequence. A descriptive progress note may lead to a calibration check, while a safety-sensitive treatment change may require a hold, definition review, and new independent sample. A threshold chosen for one target, method, or setting should not automatically govern another.

Reconcile Hugo's session and pooled results

Hugo's agreement counts sum to 11 + 9 + 7 = 27 across 12 + 10 + 11 = 33 units, giving the stated pooled result of 81.8%. The third session contributes seven agreements and four disagreements, or 63.6%. The other two sessions do not cancel that signal. Under the predeclared rule, the third session triggers review even though the pooled result exceeds 80%.

Retain the six disagreements by session and type. A safety-definition mismatch receives review regardless of the percentage. This keeps a small but important error from disappearing inside a broad denominator.

Avoid treating a cutoff as validation

IOA describes consistency under the sampled definitions and conditions. It does not establish that observers measured the right construct, that data collection influenced no one, or that the intervention is effective. Review treatment integrity, direct client input, access, health variables, outcomes, and the clinical relevance of disagreements alongside agreement.

Trend the raw numerators and denominators over time. A stable percentage with shrinking coverage or a changing opportunity mix may represent weaker evidence. Record pending samples so only mature observations enter a review-period summary.

Apply the field control to one defined question

The decision-linked IOA review rule for Hugo begins with the exact decision, the responsible qualified role, and the evidence needed. Preserve original observer records, matched exposure, the selected calculation, raw numerator and denominator, unrounded result, and every excluded or unresolved unit.

Work the example for Hugo

Hugo's sessions yield 11 of 12, 9 of 10, and 7 of 11 agreements: 91.7%, 90%, and 63.6%. Pooled IOA is 27 of 33, or 81.8%. The predeclared rule flags any session below 80% and every safety-definition disagreement, so the third session triggers review.

Audit the denominator for Hugo

The denominator for Hugo is the eligible cohort defined before review. Report planned, due, observed, matched, invalid, missing, and open units separately. A percentage gains meaning from the unit, coverage, dates, conditions, and disagreement pattern.

Protect access and safety during the sample for Hugo

The observation for Hugo keeps AAC, interpreters, mobility, food, water, bathroom use, prescribed care, health supports, rest, relationships, and emergency help available. Observer procedure never delays immediate safety or mandated action. Record changes in access, health, assent, distress, visibility, staff behavior, or routine.

Use current sources within their scope for Hugo

For Hugo, the BACB ethics hub points to current ethics materials. The CASP public summary supplies high-level autism-treatment scope. The BACB Ethics Code addresses competence, client involvement, consent and assent when applicable, documentation, supervision, risk, and evaluation for covered behavior analysts. The BCBA Test Content Outline includes measurement, reliability, sampling, and data-based decisions as examination content.

For Hugo and the qualified IOA thresholds question, Vollmer, Sloman, and St. Peter Pipkin discuss practical implications of data reliability and treatment-integrity monitoring. Essig, Rotta, and Poling review IOA and fidelity reporting in an identified research corpus. Reed and Azulay describe agreement calculations and a calculation tool. ASHA says AAC users should always have access to their tools or devices. The responsible clinician still selects a case-specific measurement and review plan.

Close the IOA review for Hugo

Review the decision-linked IOA review rule with Hugo through accessible communication and with the responsible clinician. Record the question, sample, method, arithmetic, disagreement types, limits, repair, owner, next observation, and review date. Reopen the review when the definition, observer, setting, system, exposure, access, prevalence, procedure, or decision changes.

Before release, confirm the rule existed before the result, its method and denominator match the sample, and every exception trigger was checked. Record the action, owner, due date, and evidence needed to clear the review state.

Related resources

Sources