Plan Representative Treatment-Integrity Sampling

To plan representative treatment integrity sampling, define the population of sessions or opportunities first. Sample across implementers, routines, settings, times, risk levels, procedure versions, and observation modes that could change performance. Track announced observations, missed samples, exclusions, and observer coverage. Convenience samples can guide coaching, yet they should not be described as representative of unobserved care.

Define the sampling frame

List the sessions, opportunities, people, settings, and dates eligible for review. A sampling rate needs a known population.

Freeze the frame for the reporting period and preserve additions, cancellations, missed opportunities, and procedure-version changes. Include the roles and routines to which the eventual conclusion may apply. If the frame cannot be enumerated exactly, document the best available source and limitation. Do not calculate coverage only among sessions the observer happened to attend.

Stratify meaningful variation

Select dimensions that could change implementation, such as staff experience, routine complexity, time, client state, risk, location, or version. Avoid creating tiny cells with no decision value.

Choose strata from the clinical question and plausible implementation barriers, then set a minimum useful sample for each. Oversample rare critical routines when needed while reporting their different selection probability. Keep unmatched or small cells descriptive. Revisit the design if the sample repeatedly misses the settings, people, or opportunities that motivated the review.

Track observation reactivity

Record whether the implementer knew the timing, whether coaching occurred, and whether the observer changed the routine. Interpret observed performance within those conditions.

Compare announced, routine, and minimally reactive observations only when consent, privacy, and applicable rules permit. Note supervisor presence, camera or technology effects, and any prompt delivered during observation. A coached session can show supported performance but should not be reported as independent implementation. Ask the client whether observation changed comfort, participation, or privacy.

Keep missed samples visible

Report completed samples divided by samples due, plus the reason and age of every miss. Repeated missingness in one condition is itself an operational signal.

Use states such as not yet due, due but missed, no eligible opportunity, declined, invalid, or rescheduled with reason. Assign an owner and deadline for actionable misses. Avoid repeatedly moving difficult samples into a later period until they disappear. Report how missingness may bias the result, especially when high-risk routines or understaffed settings are least observable.

At each review, compare the achieved sample with the frozen frame before interpreting integrity. Report overrepresented and underrepresented cells, weighting or stratification choices, and whether the evidence supports the planned scope. Adjust future sampling prospectively. Preserve earlier selection rules and completed observations so improving coverage does not silently rewrite what a prior report could legitimately conclude.

Put the representative sampling plan into practice

Celine's plan stratifies four staff, home and center routines, early and late sessions, and two procedure versions. The schedule includes announced and minimally reactive observations. Every due sample remains visible if the session is cancelled, the observer is unavailable, or the required opportunity never occurs.

Compare measurement options for Celine

Celine's team compares direct observation, component scoring, opportunity sampling, duration, permanent product, structured interview, system record, and direct client feedback only when each option can answer the representative integrity sampling plan's decision. Record validity, visibility, reactivity, effort, privacy, access, timeliness, and what each source cannot establish.

Pilot Celine's representative integrity sampling plan

Test the definition, form, observer instructions, technology, access, timing, missing-data states, and review workflow in representative conditions. Ask Celine and the implementer whether the process changes the routine or adds burden. Revise the measurement system before using it for coaching, treatment change, supervision, or performance decisions.

Protect access and clinical responsibility for Celine

Celine's review keeps AAC, interpreters, mobility, food, water, bathroom use, prescribed care, health support, rest, relationships, and emergency help available. Obtain required consent and assent when applicable and follow the governing response to withdrawal or distress. A qualified clinician retains responsibility for clinical interpretation and treatment decisions; a fidelity score does not transfer that responsibility.

Keep procedure versions and evidence states separate

For Celine, record the active procedure version, date, author, authorized adaptations, temporary responses, observed deviations, missing evidence, and unresolved classifications. Preserve the original record. Add a dated explanation whenever a correction or later review changes the procedure version used to judge an observation.

Ask six integrity questions for Celine

Use these questions in the representative integrity sampling plan:

Which decision, procedure version, component, cue, and eligible opportunity apply?
Which client, implementer, setting, time, and observation conditions were sampled?
Which access, safety, health, consent, assent, and communication supports were present?
Which integrity, exposure, outcome, experience, adverse-effect, and agreement series stay separate?
Which missing evidence, adaptation, drift, burden, reactivity, or concurrent change limits interpretation?
Which owner, repair, stop rule, next evidence step, and review date follow?

Keep every unresolved item visible with a state, owner, age, and next action.

A fictional integrity example for Celine

Celine is fictional and involved in a home and center communication program delivered by four staff across weekdays. Reviewers freeze 32 person, routine, setting, time, risk, version, observer, announced-status, missing, and coverage fields and complete 23 of 32 by the checkpoint. Every missing, unobservable, inapplicable, adapted, drifted, failed, or pending field keeps its defined state.

The representative integrity sampling plan measures evidence completeness. It does not establish effectiveness, safety, acceptability, medical necessity, authorization, payment, compliance, generalization, maintenance, or causation. Report the applicable raw counts and conditions before a percentage.

Use current sources within their scope for Celine

For Celine's representative integrity sampling plan, the CASP public summary supplies high-level individualized assessment, implementation, and evaluation scope for ABA treatment of autistic people. The BACB Ethics Code addresses competence, client involvement, consent and assent when applicable, risk, documentation, supervision, and evaluation for covered behavior analysts. The BCBA Test Content Outline includes procedural fidelity as examination content; it is not a case protocol or universal threshold.

For Celine's representative integrity sampling plan, the Ferguson practitioner guide supports observable component and eligible-opportunity design. The Essig, Rotta, and Poling review supports caution about the consistency and interpretation of fidelity reporting in the literature it examined. ASHA's AAC guidance says AAC users should always have access to their communication tools or devices. None of these sources makes one sampling rate, percentage, or repair rule valid for every case.

Close Celine's review

Ask Celine and each implementer to review the representative integrity sampling plan through accessible communication. Record the selected decision, raw evidence, procedure version, direct feedback, limitations, responsible role, repair, next observation, and review date. Reopen the analysis when the goal, procedure, client preference, access, health, setting, implementer, risk, or outcome changes.

How to Plan Representative Treatment-Integrity Sampling