Can Families Ask for ABA Treatment Fidelity Data?

Review the fidelity summary

Request raw counts with the percentage. For example, ask for correctly completed components divided by components due, plus the number of sessions and opportunities observed. Ask whether critical components are reported separately and whether observation covered different staff, times, and settings relevant to the decision.

Families can ask for the information in plain language. The most useful response often combines a short explanation with a small table showing what was observed, how much care was sampled, which critical components were missed, and what happened next. A practice may need to protect information about other clients or confidential workforce matters while still explaining the client's own care and the measurement used.

Understand what the number measures

Treatment fidelity data describe how closely observed implementation matched defined plan steps. They do not automatically show whether the plan helped, whether the client agreed with it, or whether the observer sampled a representative part of care.

Two common calculations answer different questions:

• Opportunity-level fidelity: opportunities with all required critical steps completed divided by eligible opportunities observed.
• Component-level fidelity: correctly completed due components divided by all due components observed.

Suppose four steps are due in each of five opportunities. Staff complete 17 of 20 steps, which is 85% component fidelity. Only two opportunities contain all four steps, which is 40% opportunity-level fidelity. Both values can be accurate. The family needs the labels and raw counts to understand the difference.

Define the scored components

A family summary can protect staff privacy while naming the observer's role, qualification, relationship to the case, and observation window. It should identify missing observations and changes in plan version. A monthly average without its components and coverage can conceal important variation.

Predefine exclusions. An observer should not remove a difficult opportunity after seeing the result. If a session could not be scored because a camera failed, the client withdrew from the activity, an emergency occurred, or required information was missing, record the reason and keep the unobserved portion visible. “Eight observations completed out of twelve due” answers a different question from “seven of eight completed observations met the criterion.”

Ask how much care was observed

Observation coverage affects interpretation. A high score from one five-minute segment cannot describe an entire month of varied services. Ask how observation dates, staff, settings, times, and procedures were chosen. Scheduled and unscheduled observations each have tradeoffs. Staff may perform differently when they know they are being watched, while an unscheduled observation can miss uncommon but important situations.

Coverage can be reported as completed observations divided by observations due, observed eligible opportunities divided by eligible opportunities available during the sampled period, or another clearly defined measure. Use the unit that fits the decision and avoid combining unlike denominators.

Use clinical and measurement sources carefully

The CASP public summary places assessment, planning, implementation, and evaluation within its autism-treatment scope. The BACB Ethics Code addresses competence, client involvement, consent and assent when applicable, risk, documentation, and evaluation for covered behavior analysts.

The BCBA Test Content Outline includes procedural fidelity as examination content. It supplies a professional knowledge map rather than a case protocol, legal standard, or universal percentage threshold.

Read the evidence with its limits

A 2024 practitioner guide recommends defining observable components and valid opportunities. A reporting review found fidelity reporting was less consistent than observer-agreement reporting in the literature it examined.

Keep communication and access visible

The ASHA AAC portal supports continuous access to communication tools. Fidelity records should show whether communication, health, mobility, sensory, and other required supports were available during the scored opportunity.

Client experience belongs beside implementation data. Ask how the client communicated comfort, confusion, dissent, preference, or a request to pause. Those signals are not fidelity errors by the client. They can reveal whether staff followed the response and stop rules and whether the plan remains acceptable and feasible.

What a useful family-facing report contains

A concise report can include:

• the plan version and procedure observed
• the observation period, settings, staff roles, and observer role
• the opportunity and component definitions
• raw counts and correctly labeled percentages
• critical-step results and unobserved portions
• client feedback, outcome measures, and any adverse event reviewed separately
• the decision, owner, due date, and next measurement point

Families can ask for corrections when the report uses a retired plan, omits failed setup steps, changes the denominator, or treats missing data as success. The provider should preserve the original result and document a corrected analysis rather than silently replacing it.

A practical example

Asha receives a summary of twelve planned observations. Ten occurred, and eight met every critical component. The practice reports observation completion as 10 of 12, or 83.3%, and critical-component success as 8 of 10, or 80%, keeping the two denominators separate.

The family also sees that both missed observations involved waiting for Asha's AAC response. The overall summary had hidden a repeated communication issue. The supervisor coaches the response-window step and schedules four observations across two staff members. In the follow-up, the step occurs in all four relevant opportunities, and Asha's successful messages are reported separately. The data now support a specific supervision decision instead of a vague assurance that fidelity was high.

Data access and privacy boundaries

The exact record a family may inspect or receive depends on applicable health-record, privacy, consent, representative-authority, payer, and state rules. A request for the client's information does not automatically entitle someone to another client's record, private employee discipline, or a raw recording containing other people. The practice should route the request through its record-access process and offer the usable client-specific information it can provide.

If a summary replaces raw material, ask how the summary was produced and whether counts, plan version, exclusions, and decisions can be verified. A summary should make the measurement clearer, not erase unfavorable results.

Prepare for the review conversation

Bring one or two decisions you want the data to inform. You may want to know whether a communication support is used consistently, whether a staff change affected implementation, or whether the same procedure fits home and center settings. Ask the provider to send definitions and raw counts before the meeting when possible. During the discussion, write down which question the available sample can answer, which information is still missing, and the date of the next review. This keeps the meeting focused on care decisions instead of debating an isolated percentage.

Questions families can use

Ask what was scored, which opportunities counted, who observed, how much of care was sampled, which components were missed, whether the client reported fit, and what decision the data informed.