To audit an IOA worksheet for calculation errors, trace each row to locked observer records, verify matched units and the selected method, inspect formulas and ranges, test zero and missing states, reproduce rounding, and retain version history. Use a second calculation path for spot checks. Release follows a documented review of both arithmetic and measurement assumptions.
Trace source lineage
Link each worksheet row to the observer records, sample, definition, procedure version, and valid exposure.
Test formula boundaries
Inspect numerator and denominator ranges, copied formulas, filters, hidden rows, and manual overrides.
Exercise edge states
Test zeros, joint zeros, blanks, invalid units, unmatched events, division by zero, and partial exposure.
Recalculate independently
Use a protected check column, second tool, or reviewer and compare unrounded results before release.
Map the complete calculation path
Document the source file, observation IDs, eligible-unit filter, match rule, formula, range, rounding rule, output cell, and report destination. Keep a data dictionary for blank, zero, invalid, missing, unmatched, and excluded values. A blank cell should never silently become a zero or an agreement.
Protect formulas and reference tables while allowing authorized reviewers to inspect them. Record workbook version, software version, author, reviewer, and checksum or another stable file identifier. Preserve the released copy and the corrected copy so the change remains auditable.
Reconcile Jonah's audit findings
Jonah's categories account for 3 + 1 + 2 = 6 affected rows out of 24, yielding 25%. This arithmetic assumes the three categories describe six distinct rows. If one row has both an incorrect denominator and premature rounding, report six error findings and fewer than six affected rows. Label those units separately to avoid double counting.
After correction, the second reviewer reproduces 24 of 24 rows. That result demonstrates reproducibility under the reviewed inputs and formulas. It does not establish that the response definition, sample, or selected IOA method is clinically appropriate.
Test edge cases before release
Use a small fixture with known expected outputs. Include joint zeros, one-sided zeros, missing observations, invalid intervals, unmatched events, partial windows, duplicated rows, filtered rows, and a final row at the bottom of the range. Confirm division-by-zero behavior and display undefined results explicitly.
Recalculate a sample by hand or with an independent implementation. Compare unrounded values before applying the display rule. For copied formulas, inspect the first, middle, and final rows plus every boundary where the denominator changes.
Repair the smallest affected layer
Correct a wrong range or formula while preserving the raw observer records. A mismatch in exposure or event pairing requires repair earlier in the pipeline and may invalidate several downstream cells. Record the cause, affected outputs, reviewer, approval, and whether any prior report needs correction.
Apply the field control to one defined question
The IOA worksheet audit for Jonah begins with the exact decision, the responsible qualified role, and the evidence needed. Preserve original observer records, matched exposure, the selected calculation, raw numerator and denominator, unrounded result, and every excluded or unresolved unit.
Work the example for Jonah
Jonah audits 24 rows. Three use an incorrect denominator, one formula omits the final row, and two round intermediate values too early. Six of 24 rows, or 25%, require correction. After repair, a second reviewer reproduces all 24 rows while the original findings remain in the audit trail.
Audit the denominator for Jonah
The denominator for Jonah is the eligible cohort defined before review. Report planned, due, observed, matched, invalid, missing, and open units separately. A percentage gains meaning from the unit, coverage, dates, conditions, and disagreement pattern.
Protect access and safety during the sample for Jonah
The observation for Jonah keeps AAC, interpreters, mobility, food, water, bathroom use, prescribed care, health supports, rest, relationships, and emergency help available. Observer procedure never delays immediate safety or mandated action. Record changes in access, health, assent, distress, visibility, staff behavior, or routine.
Use current sources within their scope for Jonah
For Jonah, the BACB ethics hub points to current ethics materials. The CASP public summary supplies high-level autism-treatment scope. The BACB Ethics Code addresses competence, client involvement, consent and assent when applicable, documentation, supervision, risk, and evaluation for covered behavior analysts. The BCBA Test Content Outline includes measurement, reliability, sampling, and data-based decisions as examination content.
For Jonah and the reproducible IOA calculations question, Vollmer, Sloman, and St. Peter Pipkin discuss practical implications of data reliability and treatment-integrity monitoring. Essig, Rotta, and Poling review IOA and fidelity reporting in an identified research corpus. Reed and Azulay describe agreement calculations and a calculation tool. ASHA says AAC users should always have access to their tools or devices. The responsible clinician still selects a case-specific measurement and review plan.
Close the IOA review for Jonah
Review the IOA worksheet audit with Jonah through accessible communication and with the responsible clinician. Record the question, sample, method, arithmetic, disagreement types, limits, repair, owner, next observation, and review date. Reopen the review when the definition, observer, setting, system, exposure, access, prevalence, procedure, or decision changes.
Before release, confirm source lineage, formula protection, edge-case tests, independent reproduction, and version retention. Verify that every corrected output can be traced to the unchanged raw records and that any downstream report received the correct version.
Related resources
- How to Preserve Observer Independence During IOA
- How to Investigate Low IOA in ABA Data
- How to Reduce Observer Reactivity During IOA
- How to Interpret IOA Thresholds Without a Universal Cutoff
Sources
- Behavior Analyst Certification Board, Ethics Codes
- Council of Autism Service Providers, ABA Practice Guidelines Version 3.0 public summary
- Behavior Analyst Certification Board, Ethics Code for Behavior Analysts
- Behavior Analyst Certification Board, BCBA Test Content Outline, 6th edition
- Vollmer, Sloman, and St. Peter Pipkin, Practical Implications of Data Reliability and Treatment Integrity Monitoring
- Essig, Rotta, and Poling, Interobserver Agreement and Procedural Fidelity: An Odd Asymmetry
- Reed and Azulay, A Microsoft Excel 2010 Based Tool for Calculating Interobserver Agreement
- American Speech-Language-Hearing Association, Augmentative and Alternative Communication