Report Treatment Integrity Without Overclaiming

To report treatment integrity without overclaiming, name the procedure version, sampling frame, observed conditions, components, eligible opportunities, observers, agreement, exposure, client outcomes and experience, access, missingness, adaptations, drift, adverse effects, repairs, and limitations. Pair percentages with raw counts. Describe implementation under the sampled conditions. Reserve claims about effectiveness, safety, generalization, compliance, or causation for evidence that can support them.

Lead with scope

State the client or cohort, procedure version, dates, settings, implementers, sampling method, exposure window, and reason for review.

Describe the eligible population and observations due, not only the completed sample. Identify announcement status, observation mode, relevant roles, and any settings or periods excluded with reasons. Match the scope to the intended decision. A report designed for one client's clinical review should not be reused as an organization-wide employment comparison without separate valid authority and evidence.

Show raw evidence

Report correct components over components due, observation coverage, missing events, critical-step results, and agreement pairs. Keep adaptations and drift classified.

Place raw counts beside percentages and show version-specific denominators, small samples, invalid records, and held observations. Separate not due, unobservable, declined, adapted, and missing states. Report agreement on the exact sampled pairs. Avoid composite scores that combine implementation, client outcomes, experience, and access because those constructs answer different questions and can move in different directions.

Pair implementation with lived outcomes

Present Joon's chosen outcomes, direct experience, effort, adverse effects, access, generalization, and maintenance beside integrity, with every series visible on its own terms.

Align dates and exposure windows while preserving the source and denominator for each measure. Support direct client communication and label proxy reports separately. State whether the sample is mature and whether concurrent plan, health, staffing, or setting changes occurred. Accurate implementation is important evidence, but it does not itself establish benefit, safety, acceptability, causation, or generalization.

Use bounded conclusions

Describe what was implemented, where, by whom, and under which conditions. Name design limits, concurrent changes, unresolved items, and the next decision.

Use language proportionate to sampling and measurement quality, such as observed high implementation in three announced clinic sessions rather than staff consistently followed the plan. Identify what the evidence cannot answer and what additional review is needed. Route clinical, coaching, quality, privacy, payer, employment, and certification actions through their respective owners instead of implying one report authorizes them all.

End with an explicit decision ledger: open question, responsible role, current safeguard, evidence needed, due date, and next review. Preserve holds and disagreements rather than excluding them from the narrative. Give the client or representative an accessible explanation when the report affects care. Version later corrections so readers can distinguish new evidence from a rewritten conclusion.

Put the bounded integrity report into practice

Joon's report separates two procedure versions and states which visits each governed. It gives component counts, observation coverage, agreement sampling, client exposure, outcomes, direct feedback, access failures, adaptations, and repairs. The conclusion applies only to the observed settings and period and identifies the next evidence needed.

Compare measurement options for Joon

Joon's team compares direct observation, component scoring, opportunity sampling, duration, permanent product, structured interview, system record, and direct client feedback only when each option can answer the treatment-integrity results report's decision. Record validity, visibility, reactivity, effort, privacy, access, timeliness, and what each source cannot establish.

Pilot Joon's treatment-integrity results report

Test the definition, form, observer instructions, technology, access, timing, missing-data states, and review workflow in representative conditions. Ask Joon and the implementer whether the process changes the routine or adds burden. Revise the measurement system before using it for coaching, treatment change, supervision, or performance decisions.

Protect access and clinical responsibility for Joon

Joon's review keeps AAC, interpreters, mobility, food, water, bathroom use, prescribed care, health support, rest, relationships, and emergency help available. Obtain required consent and assent when applicable and follow the governing response to withdrawal or distress. A qualified clinician retains responsibility for clinical interpretation and treatment decisions; a fidelity score does not transfer that responsibility.

Keep procedure versions and evidence states separate

For Joon, record the active procedure version, date, author, authorized adaptations, temporary responses, observed deviations, missing evidence, and unresolved classifications. Preserve the original record. Add a dated explanation whenever a correction or later review changes the procedure version used to judge an observation.

Ask six integrity questions for Joon

Use these questions in the treatment-integrity results report:

Which decision, procedure version, component, cue, and eligible opportunity apply?
Which client, implementer, setting, time, and observation conditions were sampled?
Which access, safety, health, consent, assent, and communication supports were present?
Which integrity, exposure, outcome, experience, adverse-effect, and agreement series stay separate?
Which missing evidence, adaptation, drift, burden, reactivity, or concurrent change limits interpretation?
Which owner, repair, stop rule, next evidence step, and review date follow?

Keep every unresolved item visible with a state, owner, age, and next action.

A fictional integrity example for Joon

Joon is fictional and involved in a ten-week community communication program with two procedure versions. Reviewers freeze 39 version, sample, component, opportunity, observer, agreement, exposure, outcome, experience, adaptation, repair, and limitation fields and complete 28 of 39 by the checkpoint. Every missing, unobservable, inapplicable, adapted, drifted, failed, or pending field keeps its defined state.

The treatment-integrity results report measures evidence completeness. It does not establish effectiveness, safety, acceptability, medical necessity, authorization, payment, compliance, generalization, maintenance, or causation. Report the applicable raw counts and conditions before a percentage.

Use current sources within their scope for Joon

For Joon's treatment-integrity results report, the CASP public summary supplies high-level individualized assessment, implementation, and evaluation scope for ABA treatment of autistic people. The BACB Ethics Code addresses competence, client involvement, consent and assent when applicable, risk, documentation, supervision, and evaluation for covered behavior analysts. The BCBA Test Content Outline includes procedural fidelity as examination content; it is not a case protocol or universal threshold.

For Joon's treatment-integrity results report, the Ferguson practitioner guide supports observable component and eligible-opportunity design. The Essig, Rotta, and Poling review supports caution about the consistency and interpretation of fidelity reporting in the literature it examined. ASHA's AAC guidance says AAC users should always have access to their communication tools or devices. None of these sources makes one sampling rate, percentage, or repair rule valid for every case.

Close Joon's review

Ask Joon and each implementer to review the treatment-integrity results report through accessible communication. Record the selected decision, raw evidence, procedure version, direct feedback, limitations, responsible role, repair, next observation, and review date. Reopen the analysis when the goal, procedure, client preference, access, health, setting, implementer, risk, or outcome changes.

How to Report Treatment Integrity Without Overclaiming