Preserve Observer Independence During IOA in ABA

To preserve observer independence during IOA, assign both observers before the sample, give each a separate record, block access to the other score, and lock both records before comparison or feedback. Predefine urgent safety exceptions and document every departure. Independence reduces shared-score influence. It cannot prove that the definition is valid or that either observer is accurate.

Separate the records

Use separate forms, devices, logins, or hidden fields. Restrict exports and dashboards until both records are locked.

Control communication during scoring

Observers may coordinate immediate safety action. Discussion of response definitions, prompts, or scores waits until the sample closes.

Record independence evidence

Keep assignment time, observation window, lock time, access logs, interruptions, and any score exposure.

Debrief after both records lock

Compare disagreements, repair definitions or training, and preserve the original records before any correction.

Design independent capture before the observation

Independence begins with the recording system. Give each observer a separate login, device, form, or paper record. Hide live totals, graphs, alerts, and auto-filled fields that reveal the other observer's entries. Confirm permissions with a short test before the sample, then retain the access and lock timestamps. A shared spreadsheet can still work when columns remain hidden and editing history shows that each record was completed before comparison.

Plan how questions will be handled. An observer who becomes unsure about a definition should mark the unit and continue under the written rule when safe. A message asking the other observer what they scored changes the evidence. Route procedural questions to a named supervisor after both records close, unless the issue affects immediate safety.

Classify every departure from independence

Use distinct states such as fully independent, possible exposure, confirmed exposure, urgent safety coordination, and technical failure. Record the first affected unit and the information that became visible. Keep the original score even when the sample is repeated.

For Amina, the glimpse before trial nine means trials nine through twelve may have been influenced. The reported ten agreements across twelve trials remains a descriptive result for the complete sample. The page does not provide the agreement count for trials one through eight, so a clean-segment percentage cannot be reconstructed. Report the information gap and schedule another independent sample instead of inventing a cleaner estimate.

Separate urgent coordination from score sharing

Safety action takes priority over observer separation. Predefine who calls for help, who supports the person, and how scoring pauses. Document the time, reason, response, and affected units. Coordination about an immediate hazard does not license discussion of tallies, likely functions, or expected scores during the remaining sample.

Apply the field control to one defined question

The observer-independence log for Amina begins with the exact decision, the responsible qualified role, and the evidence needed. Preserve original observer records, matched exposure, the selected calculation, raw numerator and denominator, unrounded result, and every excluded or unresolved unit.

Work the example for Amina

Amina's observers score twelve matched trials and agree on ten, or 83.3%. The log also shows that one observer glimpsed the other's tally before trial nine. Report that departure and repeat an independent sample rather than treating 83.3% as clean evidence.

Audit the denominator for Amina

The denominator for Amina is the eligible cohort defined before review. Report planned, due, observed, matched, invalid, missing, and open units separately. A percentage gains meaning from the unit, coverage, dates, conditions, and disagreement pattern.

Protect access and safety during the sample for Amina

The observation for Amina keeps AAC, interpreters, mobility, food, water, bathroom use, prescribed care, health supports, rest, relationships, and emergency help available. Observer procedure never delays immediate safety or mandated action. Record changes in access, health, assent, distress, visibility, staff behavior, or routine.

Use current sources within their scope for Amina

For Amina, the BACB ethics hub points to current ethics materials. The CASP public summary supplies high-level autism-treatment scope. The BACB Ethics Code addresses competence, client involvement, consent and assent when applicable, documentation, supervision, risk, and evaluation for covered behavior analysts. The BCBA Test Content Outline includes measurement, reliability, sampling, and data-based decisions as examination content.

For Amina and the independent IOA observation question, Vollmer, Sloman, and St. Peter Pipkin discuss practical implications of data reliability and treatment-integrity monitoring. Essig, Rotta, and Poling review IOA and fidelity reporting in an identified research corpus. Reed and Azulay describe agreement calculations and a calculation tool. ASHA says AAC users should always have access to their tools or devices. The responsible clinician still selects a case-specific measurement and review plan.

Close the IOA review for Amina

Review the observer-independence log with Amina through accessible communication and with the responsible clinician. Record the question, sample, method, arithmetic, disagreement types, limits, repair, owner, next observation, and review date. Reopen the review when the definition, observer, setting, system, exposure, access, prevalence, procedure, or decision changes.

Before closing, confirm that both observers were assigned in advance, had separate records, lacked access to live scores, used the same written definition, and locked their entries before feedback. Confirm that any departure has a first affected unit, reason, owner, and disposition. These controls support a reproducible reliability review. They do not establish that the selected target or measurement system is clinically appropriate.

How to Preserve Observer Independence During IOA