To reproduce a derived ABA metric from raw data, preserve every source row, definition, inclusion rule, exclusion, transformation, formula, precision rule, software version, and intermediate result. Give a second reviewer enough information to calculate the value independently. Match both the numeric result and the eligible cohort. A reproducible calculation improves traceability, while validity, clinical meaning, and causal interpretation still require separate review.
Lock the source cohort
Record identifiers, dates, condition, definition version, inclusion state, source location, correction state, and the exact cutoff used.
Expose every transformation
Show filtering, deduplication, unit conversion, aggregation, missing-value treatment, weighting, smoothing, and any recoding in order.
State the formula completely
Name numerator, denominator, unit, time basis, constants, edge cases, precision, and rounding point.
Version tools and dependencies
Preserve worksheet, code, package, dashboard, schema, query, and configuration versions needed to rerun the calculation.
Use an independent reproduction
Have another qualified reviewer rebuild the cohort and result from the declared source rather than copying the first output.
Separate reproducibility from meaning
Review measurement validity, sampling, client value, burden, uncertainty, and decision relevance after the arithmetic reproduces.
Build Quincy's metric-reproduction packet
Create a versioned metric-reproduction packet for the reproduce derived ABA metric from raw data question. Include the client priority, exact decision, responsible roles, response and opportunity definitions, source records, measurement unit, sampling frame, numerator, denominator, missing and invalid states, access method, burden, risk, calculation lineage, tool version, review date, and approval evidence. A second reviewer should be able to reconstruct both the evidence and the workflow state.
Work through Quincy's example
Quincy's packet contains 18 source records. Seventeen are valid observations totaling 23 events across 315 minutes; one interrupted record remains visible as invalid. The rate is 23 divided by 315/60, which equals 4.38095 events per hour and displays as 4.38 under the declared two-decimal rule. A second reviewer reproduces the cohort and value. Show all source counts, held items, conditions, and calculation steps before the percentage. This fictional community recreation outcome review example illustrates one governance pattern and supplies no universal threshold, required tool, treatment recommendation, compliance conclusion, or causal claim.
Audit Quincy's evidence trail
Quincy's packet includes all 18 rows, the invalid-state reason, 17-row cohort, event and minute totals, unit conversion, formula, unrounded value, display precision, code or worksheet version, reviewer output, and timestamp. The audit checks current definitions, raw records, source identity, collector and reviewer roles, client communication access, sampling, corrections, calculations, displays, permissions, decision use, and unresolved holds. Reviewers preserve the evidence available at each earlier decision rather than letting a later system state rewrite history.
Address Quincy's main governance risk
Two analysts can match a rounded number while using different rows or assumptions. Quincy's acceptance test requires matching identifiers, states, totals, units, intermediate results, and final display. A clean percentage can conceal an incomplete cohort, incompatible definition, biased sample, inaccessible process, wrong source, or unauthorized decision. Review the numerator, denominator, excluded states, client impact, and authority before accepting the display.
Choose Quincy's next action
Any mismatch becomes a named issue with owner, source, affected outputs, correction history, and decision impact. The original published value remains tied to its calculation version. Record the selected action, rationale, responsible role, client response, due date, evidence required for closure, and conditions that reopen review. Software may detect, calculate, compare, and route. The qualified professional makes case-specific clinical decisions within applicable authority.
Protect Quincy's access and participation
Keep Quincy's AAC, interpreters, mobility, food, water, bathroom use, prescribed care, health support, rest, relationships, and emergency help available during measurement. Offer accessible and private ways to ask questions, correct a record, decline optional observation, pause, or communicate distress. A system-quality test should improve evidence without creating an artificial or unsafe condition.
Apply current sources to Quincy's review
Quincy's sources support transparent single-case measurement and analysis while the packet defines local computational provenance. The BACB ethics hub and CASP public summary provide professional and clinical context. The BCBA Test Content Outline identifies measurement, validity, reliability, sampling, graphing, and data-based decisions as examination content. The WWC handbook supplies research-review standards. Reviews of single-case design and quality and systematic visual-analysis protocols support explicit methods and evidence trails. Research on graphing rate with fidelity illustrates the value of aligned measures. An evidence-based ABA framework places research, clinical expertise, context, and client values together. ASHA supports continuous AAC access.
Rehearse Quincy's governance workflow
Test the metric-reproduction packet with a missing source row, conflicting definition, zero-opportunity record, inaccessible form, declined observation, biased sample, stale calculation, software default, role-permission error, late correction, and decision with no owner. Confirm that every item remains visible, the correct denominator survives, urgent concerns route immediately, historical states remain reconstructable, and release gates stop affected use.
Close Quincy's review
Review the metric-reproduction packet with Quincy, the responsible clinician, and specialists named by the manifest. Preserve raw evidence, definitions, access, sampling, burden, calculation and software versions, reviewer findings, corrections, decisions, and limits. Keep the page draft and noindex until the required clinical, client or family, accessibility, methods, technology, privacy, and legal reviews are complete.
Related resources
- How to Validate an ABA Dashboard Against Source Records
- How to Detect Data-Entry Interface Effects in ABA Measurement
- How to Audit an ABA Measurement Portfolio Across a Caseload
- How to Audit Sampling Bias in Routine ABA Observations
Sources
- Behavior Analyst Certification Board, Ethics Information and Ethics Codes
- Council of Autism Service Providers, ABA Practice Guidelines Version 3.0 public summary
- Behavior Analyst Certification Board, BCBA Test Content Outline, 6th edition
- What Works Clearinghouse Procedures and Standards Handbook, Version 5.0
- Single-Case Design, Analysis, and Quality Assessment for Intervention Research
- Systematic Protocols for the Visual Analysis of Single-Case Research Data
- Graphing the Intersection of Rate and Fidelity in Single-Case Research
- Ethical Behavior Analysis: Evidence-Based Practice as a Framework for Ethical Decision Making
- American Speech-Language-Hearing Association, Augmentative and Alternative Communication