To choose an IOA calculation for ABA data, start with the measurement dimension, unit, event prevalence, observation system, matching feasibility, and clinical decision. Select a method that can reveal the disagreement that matters. Avoid choosing the formula expected to produce the highest percentage. Report a complementary calculation when one method could give false reassurance.

Identify the measurement dimension

Separate count, occurrence, trial outcome, interval score, duration, latency, and categorical response.

Check prevalence

Rare or common events can make joint absence or joint occurrence dominate an overall measure.

Assess matching feasibility

Use event-level or trial-level methods only when observers can match the same unit reliably.

Choose against false reassurance

Ask which disagreement would change the decision and whether the proposed calculation would expose it.

Start with the decision and the raw unit

Write the clinical or measurement question before selecting a percentage. Total-count agreement asks whether two aggregate counts are similar. Interval methods ask where occurrence, nonoccurrence, or counts align over time. Trial-by-trial agreement compares the same eligible opportunities. Duration-per-occurrence agreement requires events that can be matched credibly.

The stored data must support the method. A summary total cannot later produce exact interval agreement, and unmatched duration records cannot support a per-occurrence mean. Preserve the raw observer records and choose a method that another reviewer can reproduce without reconstructing detail that was never collected.

Use prevalence and disagreement costs to choose companions

When behavior is rare, overall interval agreement can be dominated by joint nonoccurrence, so scored-interval agreement can expose occurrence detection. When behavior is common, unscored-interval agreement can examine agreement on absence. Exact count agreement is strict about interval totals, while mean count-per-interval shows the relative size of count differences.

More than one result can be appropriate when each has a stated purpose. Predeclare a primary method and label companion metrics. Avoid selecting a different metric after seeing which percentage looks strongest.

Match common data questions to methods

Decision questionUseful starting methodInformation that must remain visibleWere total event counts similar across the same exposure?Total-count IOABoth totals, exposure, timing or event-match limitsDid observers agree within matched time segments?Mean or exact count per intervalBoth counts in every interval, joint zeros, interval lengthDid observers agree on the same eligible trials?Trial-by-trial IOATrial IDs, scored field, prompts, invalid and missed trialsDid observers detect rare occurrences?Scored-interval IOAFull binary table, prevalence, overall agreementDid observers agree on absences for a common event?Unscored-interval IOAFull binary table, prevalence, scored agreementDid matched occurrences have similar durations?Duration-per-occurrence IOAMatch rule, raw starts and stops, unmatched events

Use the formula and units for Rami

For Rami's IOA method-selection matrix: method selection follows the unit: totals, intervals, trials, or matched event durations require different agreement questions. Keep observer records independent until both are locked. Preserve the matched exposure, raw observations, numerator, denominator, unrounded calculation, and final rounding.

Work the arithmetic for Rami

Rami rejects total-count IOA for a trial decision because similar totals could come from different trials. He uses trial-by-trial agreement. For a rare interval event, he reports interval-by-interval and scored-interval IOA. For event duration, he matches occurrences before calculating duration agreement.

Apply the method-selection matrix prospectively

Rami's qualified clinician identifies the decision before choosing an agreement method or threshold. Compare a stricter or complementary method when prevalence, totals, or aggregation could hide relevant disagreement. Repair definitions, visibility, training, sampling, or matching before judging the implementer or client data.

Audit observer and sample conditions for Rami

Rami's record identifies observers, independence, training, recording mode, shared exposure, response definition, procedure version, observation coverage, missing pairs, reactivity, and disagreements. Consent, privacy, recording, employment, supervision, and payer rules remain separate requirements. Keep every open pair visible with an owner and next action.

Protect client access during Rami's observation

Rami's observation keeps AAC, interpreters, mobility, food, water, bathroom use, prescribed care, health support, rest, relationships, and emergency help available. Do not create extra distress or remove ordinary supports to obtain an agreement sample. Record when access, health, withdrawal, or observer presence changes the condition.

Ask five IOA questions for Rami

Use these questions in the IOA method-selection matrix:

  • Did both observers independently score the same exposure, unit, definition, and condition?
  • Which calculation, numerator, denominator, prevalence, and rounding reproduce the result?
  • Which disagreements, missing pairs, invalid units, reactivity, or matching problems remain?
  • Which validity, treatment-integrity, client-outcome, experience, and access questions stay separate?
  • Which repair, complementary method, next sample, owner, and review date follow?

Keep raw observer records and disagreement types available.

Use current sources within their scope for Rami

For Rami's IOA method-selection matrix, the BACB ethics hub points to current professional ethics materials. The CASP public summary provides high-level autism-treatment scope without licensed detailed procedures. The BACB Ethics Code addresses competence, client involvement, consent and assent when applicable, documentation, risk, supervision, and evaluation for covered behavior analysts. The BCBA Test Content Outline includes measurement, reliability, sampling, and data-based decisions as examination content rather than a case protocol.

For Rami, Vollmer, Sloman, and St. Peter Pipkin discuss practical implications of data reliability and treatment-integrity monitoring. Essig, Rotta, and Poling review IOA and fidelity reporting in an identified ABA research corpus. Reed and Azulay describe a calculation tool and agreement methods. ASHA says AAC users should always have access to their tools or devices. These sources do not create one universal IOA method or threshold.

Close Rami's agreement review

Ask Rami and the responsible clinician to review the IOA method-selection matrix through accessible communication. Record the method, arithmetic, sample, disagreements, limits, measurement repair, selected decision, next observation, and review date. Reopen the analysis when the definition, observer, system, exposure, prevalence, client access, procedure, or decision changes.

Clinician release checklist

  • Is the decision question stated before the method is selected?
  • Does the raw data contain the unit and detail required by the chosen calculation?
  • Are prevalence, exposure, matching feasibility, and costly disagreement types reviewed?
  • Is one primary method predeclared, with any companion metric labeled by purpose?
  • Are coverage, observer independence, client access, limitations, and the next repair visible?

Related resources

Sources