To audit client-experience measurement integrity in ABA, lock a mature measure cohort and test construct definition, direct client access, source labels, timing, privacy, burden, collection fidelity, observer agreement, missingness, versions, corrections, response actions, decision use, and retirement. Use fixed denominators, preserve unfavorable and missing data, assign every gap, and verify corrections in a new mature sample.

Lock the measure cohort

Define active and recently retired measures, client groups, settings, period, maturity rule, required controls, decision pathways, missingness, version status, correction status, exclusions, and owners before inspecting results.

Audit construct and access

Check named construct, decision purpose, direct client route, language, AAC, motor and sensory access, privacy, response options, source labels, proxy role, client correction, and whether the method works across intended conditions.

Audit collection quality

Review neutral scripts, partner training, role boundaries, representative sampling, observer agreement, reactivity, drift, device or form behavior, timing, reminders, withdrawal, burden, missingness, and invalid-event rules.

Audit data governance

Verify stable identity, approved version, effective date, cohort mapping, source and author, audit history, calculations, corrections, disagreement, role-based access, retention, exports, vendors, and retirement controls.

Audit response and decisions

Trace concerning and favorable evidence to qualified owner, interim support, rationale, action, implementation, client explanation, confirmation, complaint or review route, closure, and reopening. Preserve overdue work in the denominator.

Report and validate remediation

Use raw counts, fixed denominators, age, setting, method, owner, and risk. Assign each gap, protect affected clients, hold unreliable decisions, set due dates, validate repairs, and retest a fresh mature cohort without rewriting original evidence.

Select evidence that can reveal integrity failures

Yvonne should sample measures, clients, versions, collectors, settings, access modes, favorable and unfavorable responses, missing records, corrections, and completed or overdue actions. Include low-volume measures and cases that changed systems or staff. Random selection can support breadth, while risk-based selection examines known vulnerabilities; label each stratum and its selection rule. Preserve the locked population and every sampled item so unavailable records, abandoned measures, and delayed follow-up remain findings rather than quiet exclusions.

Grade findings by the decision they could affect

Classify each gap by construct, access, authorship, privacy, burden, collection, calculation, version, correction, action, or retirement impact. Connect severity to the affected decision, number and status of clients, duration, reversibility, and immediate protection needed. Avoid a single composite score that lets strong documentation conceal missing client access. Report each domain's numerator, denominator, age, evidence, owner, due date, and validation test. Reopen the finding when a repair fails in the next mature sample or when Yvonne identifies a continuing experience concern.

Require evidence before closing an audit finding

A policy update or training attendance can show that remediation began. Closure needs evidence that the corrected method works in the intended setting with relevant clients, access modes, collectors, versions, and decision routes. Define the test before implementation, preserve failures, and identify who accepts the result. Ask Yvonne whether access, privacy, burden, and follow-up improved. Record remaining limits and the next monitoring date. Findings that affect current care or rights keep an interim safeguard until qualified owners verify the durable correction.

Build Yvonne's experience-measure integrity audit

Create one versioned experience-measure integrity audit for the annual governance review. Include the construct, decision, direct client communication, source-labeled proxy evidence, consent and assent when applicable, privacy, AAC and supports, authority, method, readiness, timing, missingness, burden, versions, corrections, actions, owners, effective dates, and review triggers. Define raw units and denominators before use.

Keep Yvonne's operational record decision-ready

For Yvonne, record candidate or deployed method, source, version, question, response options, access setup, collector, setting, period, eligible events, raw responses, help, withdrawal, missing reason, privacy route, correction, uncertainty, qualified interpretation, action, implementation, client communication, confirmation, and closure. Restrict sensitive content to approved roles and systems.

Work through Yvonne's example

Yvonne audits thirty active measures. Twenty-eight define a construct, 25 have direct accessible client evidence, 23 define missingness, 21 map to a current version, 18 trace results to action, and 16 show client confirmation. Report 28/30, 25/30, 23/30, 21/30, 18/30, and 16/30 separately. Preserve all mature items, readiness states, responses, failures, raw counts, denominators, missing categories, versions, actions, and open work. This fictional example demonstrates one operational control and supplies no universal threshold, validation finding, legal conclusion, causal result, or outcome guarantee.

Use Yvonne's evidence for a bounded decision

Before collecting more data, identify the decision and authorized owner. Possible actions include clarify, restore access, retrain, revise, correct, pause, investigate, replace, retire, or close. For Yvonne, document interim protection, evidence needed, due date, implementation test, client-facing explanation, disagreement route, next review, and criteria for reopening.

Review Yvonne's results without hiding failures

For Yvonne, show raw counts beside percentages and keep inaccessible, missing, unfavorable, corrected, overdue, and reopened items visible. Segment by method, version, setting, collector, access route, and period when useful and privacy-safe. Compare cohorts only when definitions and maturity rules match, and explain material changes before interpreting a trend.

Address Yvonne's main operational risk

A perfect collection-completion rate can coexist with leading questions, inaccessible options, or no action. Yvonne's audit traces meaning, access, and response rather than counting forms alone. Review construct fit, direct client access, privacy, partner influence, burden, missingness, versions, corrections, and decision response separately. A completed form or precise score cannot compensate for a measure that asks the wrong question or leads nowhere.

Choose Yvonne's next action

Governance owners hold affected decisions, repair measures and workflows, communicate with clients, and validate the corrections in the next locked cohort. Preserve original evidence, client corrections, and disagreement. Record the qualified owner, affected measures and plan versions, interim safeguards, downstream systems, due date, validation evidence, client communication, current status, and next governance check.

Apply current professional sources to Yvonne's workflow

For Yvonne's workflow, the BACB ethics hub identifies the current Ethics Code, which addresses understandable communication, client involvement, consent and assent when applicable, confidentiality, assessment, risk, documentation, and evaluation for covered people. BACB has no separate organizational jurisdiction. The BCBA outline is examination content and supplies no practice authority. The CASP public summary gives high-level context for ABA treatment of autistic people. An evidence-based ABA framework supports research, clinical expertise, client values, and context.

Use measurement evidence for Yvonne

For Yvonne's process, the treatment-integrity practitioner guide, Essig review, impact study, and reporting review support explicit procedures, representative evidence, observer controls, and cautious interpretation. They create no universal experience threshold or validation method. Breaux and Smith offer assent-focused guidance in an evolving evidence base. ASHA supports continuous AAC access.

Close Yvonne's operations review

Review the experience-measure integrity audit with Yvonne, the responsible clinician, operational owners, privacy and access roles, and the specialists named in the manifest. Verify that the method remains understandable, accessible, private, proportionate, version-controlled, and actionable. Preserve history, supports, limits, and open gaps. Keep this page draft and noindex until required reviews are complete.

Related resources

Sources