Choose a Treatment-Integrity Measurement System

To choose a treatment integrity measurement system, start with the decision and the procedure's observable structure. Match whole-session, component, trial, opportunity, duration, permanent-product, or sampled measurement to the step, risk, variability, and available evidence. Define missing and invalid states. Pilot observer agreement and burden. Keep implementation, client outcome, and client experience as separate series.

Start with the decision

Name whether the measure will support coaching, procedure revision, safety review, exposure analysis, supervision, or outcome interpretation. The same system need not answer every question.

Write the intended decision, responsible role, population, timeframe, and evidence needed before choosing a form. A measure for immediate communication-access protection may focus on one critical component, while a plan-revision question may need representative component patterns, client experience, and outcomes. Keep clinical, quality, employment, certification, payer, and research uses separate so one dataset is not stretched beyond its valid purpose.

Match the unit to the procedure

Use component scoring for multistep procedures, opportunity scoring for event-based responses, duration for time-bound steps, and permanent products only when the product reliably represents performance.

Task-analyze the procedure and test whether the proposed unit captures when a step was actually due. Define the observer's start and stop window, conditional steps, accepted adaptations, and missing states. A permanent product cannot show timing or partner response unless those properties are preserved in the product. Pilot burden and feasibility before asking staff to collect it routinely.

Mark critical components

Identify steps whose omission changes safety, communication access, consent, or the procedure's proposed mechanism. Report them separately from a total score.

Document why each step is critical for this person and context, what immediate action follows a miss, and who reviews it. Include stop rules and prohibited actions where applicable. Avoid assuming every required component has equal consequence. A critical-step result should remain visible even when the overall percentage is high, and its follow-up should be traceable.

Reject false precision

If observers cannot see the relevant event or opportunity, record missing or unobservable. A convenient percentage based on partial evidence can be less useful than a smaller valid sample.

Report raw numerators, denominators, observation coverage, version exposure, agreement sampling, and reasons for missingness. Separate not due, not observed, invalid, declined, and adapted states. Do not impute an implementation score from attendance or documentation completion. When visibility is systematically poor, redesign the observation system or narrow the decision rather than presenting a precise but unsupported rate.

Document the selected system in a versioned measurement specification with examples, roles, privacy limits, storage, review cadence, and change control. Train observers against independent scoring examples and verify agreement before routine use. Reassess burden on the client and implementers. Retire fields that do not inform a decision instead of collecting more data merely because the form can hold it.

Put the selected measurement system into practice

Asha's art-group procedure contains a setup step, an accessible help opportunity, a partner response, and a closure step. The clinician scores critical components by opportunity and uses a brief permanent product only for material setup. A whole-session percentage would hide whether AAC access or partner response failed.

Compare measurement options for Asha

Asha's team compares direct observation, component scoring, opportunity sampling, duration, permanent product, structured interview, system record, and direct client feedback only when each option can answer the integrity measurement selection record's decision. Record validity, visibility, reactivity, effort, privacy, access, timeliness, and what each source cannot establish.

Pilot Asha's integrity measurement selection record

Test the definition, form, observer instructions, technology, access, timing, missing-data states, and review workflow in representative conditions. Ask Asha and the implementer whether the process changes the routine or adds burden. Revise the measurement system before using it for coaching, treatment change, supervision, or performance decisions.

Protect access and clinical responsibility for Asha

Asha's review keeps AAC, interpreters, mobility, food, water, bathroom use, prescribed care, health support, rest, relationships, and emergency help available. Obtain required consent and assent when applicable and follow the governing response to withdrawal or distress. A qualified clinician retains responsibility for clinical interpretation and treatment decisions; a fidelity score does not transfer that responsibility.

Keep procedure versions and evidence states separate

For Asha, record the active procedure version, date, author, authorized adaptations, temporary responses, observed deviations, missing evidence, and unresolved classifications. Preserve the original record. Add a dated explanation whenever a correction or later review changes the procedure version used to judge an observation.

Ask six integrity questions for Asha

Use these questions in the integrity measurement selection record:

Which decision, procedure version, component, cue, and eligible opportunity apply?
Which client, implementer, setting, time, and observation conditions were sampled?
Which access, safety, health, consent, assent, and communication supports were present?
Which integrity, exposure, outcome, experience, adverse-effect, and agreement series stay separate?
Which missing evidence, adaptation, drift, burden, reactivity, or concurrent change limits interpretation?
Which owner, repair, stop rule, next evidence step, and review date follow?

Keep every unresolved item visible with a state, owner, age, and next action.

A fictional integrity example for Asha

Asha is fictional and involved in a community art group with brief, variable help opportunities. Reviewers freeze 25 decision, procedure, component, opportunity, timing, sampling, access, burden, and interpretation fields and complete 18 of 25 by the checkpoint. Every missing, unobservable, inapplicable, adapted, drifted, failed, or pending field keeps its defined state.

The integrity measurement selection record measures evidence completeness. It does not establish effectiveness, safety, acceptability, medical necessity, authorization, payment, compliance, generalization, maintenance, or causation. Report the applicable raw counts and conditions before a percentage.

Use current sources within their scope for Asha

For Asha's integrity measurement selection record, the CASP public summary supplies high-level individualized assessment, implementation, and evaluation scope for ABA treatment of autistic people. The BACB Ethics Code addresses competence, client involvement, consent and assent when applicable, risk, documentation, supervision, and evaluation for covered behavior analysts. The BCBA Test Content Outline includes procedural fidelity as examination content; it is not a case protocol or universal threshold.

For Asha's integrity measurement selection record, the Ferguson practitioner guide supports observable component and eligible-opportunity design. The Essig, Rotta, and Poling review supports caution about the consistency and interpretation of fidelity reporting in the literature it examined. ASHA's AAC guidance says AAC users should always have access to their communication tools or devices. None of these sources makes one sampling rate, percentage, or repair rule valid for every case.

Close Asha's review

Ask Asha and each implementer to review the integrity measurement selection record through accessible communication. Record the selected decision, raw evidence, procedure version, direct feedback, limitations, responsible role, repair, next observation, and review date. Reopen the analysis when the goal, procedure, client preference, access, health, setting, implementer, risk, or outcome changes.

How to Choose a Treatment-Integrity Measurement System