Can Families Ask for Prompt Data by Staff and Setting?

ABA prompt data by staff

Build a table with staff role, setting, plan version, dates, opportunities, independent responses, each prompt level, declines, invalid trials, ordinary supports, observer, and client feedback. Keep names role-limited where appropriate while preserving enough attribution for supervision and correction.

Segmenting can answer a focused clinical question. It may show that prompt timing differs by partner, a natural cue is available in one setting, one task version is harder, or AAC access is less reliable in a particular location. It can also reveal that one condition has too few opportunities for a meaningful comparison. The purpose should be stated before the report is created.

Use the same units across rows:

FieldWhy it mattersPlan version and datePrevents pooling different clinical rulesStaff role and settingLocates a pattern without publishing unnecessary identity informationEligible opportunitiesSupplies the denominator for each conditionIndependent and each prompt levelShows the actual distribution of helpHelp, decline, and invalid countsKeeps client choice and system failures visibleActual prompt timingTests whether the written response window occurredOrdinary supports availableIdentifies access differencesObserver and observation coverageShows how the data were producedClient feedbackAdds the person's experience to the review

Do not compare percentages without the raw counts. Six of eight and fifteen of twenty are both 75%, but the second condition has more observed opportunities. A row with two opportunities should remain visible without being treated as a stable estimate of a staff member or setting.

Create a matched comparison

Define what must match before interpreting a difference. Consider the response, natural cue, task difficulty, materials, setting demands, time of day, response window, prompt hierarchy, ordinary supports, partner response, and data method. Exact matching is rarely possible in everyday care, so list remaining differences and limit the conclusion.

Observation coverage matters. One staff member may be observed during new learning while another receives familiar maintenance tasks. A home setting may include siblings and interruptions, while a clinic arrangement may be quiet and highly structured. Those conditions are evidence, not noise to erase.

When the setting is the focus, describe what differs rather than treating the location name as the explanation. Note cue availability, room arrangement, noise, travel, schedule, people present, privacy, materials, technology, AAC access, and the useful outcome available after the response. If the response occurs in one location only, the review should identify which conditions may need to travel with the person and which are expected to differ.

If staff and setting change together, the data cannot separate their effects. Plan a later comparison in which one factor stays more stable when that question matters and the test is appropriate. Everyday care will rarely create a perfect experiment, so the report should state what can and cannot be concluded.

Define what changes and what stays

Pooling can hide a useful pattern. It can also stigmatize one staff member when that person receives harder tasks or different settings. Compare matched conditions, check fidelity and observation coverage, and route performance support through supervision rather than turning family-facing data into a staff ranking.

Share only the detail needed for the family and clinical decision. Internal supervisors may need identifiable records to coach, correct, and document workforce performance. A family-facing summary can often use staff roles or agreed labels while explaining the pattern and response. Privacy, employment, record-access, and payer rules may affect what can be disclosed and how.

The qualified clinician interprets the clinical pattern. Operations can assemble records and check completeness. A supervisor can assess implementation within the supervisory relationship. Software can calculate defined counts, but it should not infer that a staff member caused a difference or automatically change the treatment plan.

If the review identifies a possible implementation problem, confirm it through direct observation and the applicable supervision process. Provide the staff member with the correct plan version, training, feedback, and a recheck. If the concern reflects materials, scheduling, environment, or access, assign that system repair to the appropriate owner.

Use current clinical and training sources

The CASP public summary places assessment, planning, implementation, and evaluation within its autism-treatment scope. The BACB Ethics Code addresses competence, client involvement, consent and assent when applicable, risk, assessment-based intervention, documentation, and evaluation for covered behavior analysts.

The BCBA Test Content Outline covers response and stimulus prompts, time delay, prompt fading, stimulus-control transfer, integrity, and evaluation as examination content. It does not prescribe one hierarchy or delay for every person and task.

Read prompting comparisons cautiously

Libby and colleagues and Fentress and Lerman found performance differences across participants, tasks, and prompting arrangements in small studies. They support individualized measurement rather than a universal prompting sequence.

Keep AAC access separate from prompts

The ASHA AAC portal supports continuous communication-tool access. Device availability is an access condition. Prompts for finding vocabulary, composing a message, or initiating use should be recorded separately from access to the device itself.

A practical example

With two staff in the same room and task, Eli responds before added help in six of eight opportunities with Staff A and three of eight with Staff B. Both use the same plan version and materials. Review of actual timing shows that Staff B prompts before the planned five-second window in five opportunities. The difference does not establish that Staff B is less competent, but it identifies a specific implementation question.

The supervisor observes Staff B, practices the wait rule, and confirms that Eli's AAC response beginning is recognized. In the next eight matched opportunities with Staff B, Eli responds before added help in five, after a gesture in two, and asks for help in one. Staff honor the help request. These counts show improved adherence and a different response distribution during the recheck. They do not prove that coaching caused the change or predict every setting.

The family summary reports the two periods, task, opportunity counts, timing finding, repair, and next review. It does not publish unrelated personnel information or turn the percentages into a leaderboard.

How to ask for the data

Use a focused request: “Can we review whether the same prompt timing and definitions are being used across staff and settings for this goal?” Identify the date range and decision the family is preparing for. Ask for opportunity counts, prompt levels, help and decline responses, invalid opportunities, ordinary supports, and plan version.

If a practice cannot produce the comparison, ask what records do exist and how the team checks consistency. The answer may lead to a prospective review rather than a retrospective claim. Predefine the table and observe a reasonable set of ordinary opportunities before interpreting differences.

Questions families can use

Ask whether definitions and tasks match, how many opportunities each staff member had, which settings differed, who observed, whether prompt timing varied, what the client reported, and how supervision responds.