Accommodations Toolkit

Recorded Oral Delivery: Research

National Center on Educational Outcomes (NCEO)

This fact sheet on recorded oral delivery is part of the Accommodations Toolkit published by the National Center on Educational Outcomes (NCEO). It summarizes information and research findings on recorded oral delivery as an accommodation[1]. This toolkit also contains a summary of states’ accessibility policies for recorded oral delivery.

What is recorded oral delivery? Recorded oral delivery is a form of prerecorded audio delivery of assessments. Common forms of prerecorded oral delivery include audiocassette tapes, CD-ROMs, audio DVDs, screen reader, and other forms of audio file presentations (Harris, 2008; Laitisus, 2010). This accommodation is used as an alternative to a live human reader as a form of oral delivery for an assessment.

What are the research findings on who should use this accommodation? Research has shown that students who benefited from using recorded oral delivery of assessments are elementary and secondary students with learning disabilities (LD) (Helwig et al., 2002; Laitusis, 2010; Tindal, 2002) and secondary students with a visual impairment (VI) (Erin et al., 2006). 

What are the research findings on the implementation of recorded oral delivery? Twelve studies were located that addressed the effects of recorded oral delivery. 

  • Mixed results were found on the effects of recorded oral delivery for students with disabilities for mathematics assessments. Two studies found there was no difference in performance between the use of recorded oral delivery and no accommodation for elementary and secondary students with various disabilities (Snyder, 2010) and secondary students with and without learning disabilities (Schnirman, 2005). In contrast, two studies found a positive effect with recorded oral delivery. In one study there was increased performance for the accommodated elementary students with LD, but no significant improvement for secondary students with LD compared to students at all grade levels without LD (Helwig, 2002). Similarly, another study of elementary students with various disabilities outperformed secondary students with disabilities when they received prerecorded oral delivery (Tindal, 2002).
  • Mixed results were found on the effects of recorded oral delivery for elementary and secondary students with various disabilities for English Language Arts (ELA) assessments. One study found there was no difference in performance between the use of recorded oral delivery and no accommodation for either elementary students with various disabilities or elementary students without disabilities (Kosciolek & Ysseldyke, 2000). A second study found elementary and secondary students with and without learning disabilities performed better with an audio presentation over no accommodation (Laitusis, 2010).
  • A study on the use of recorded oral delivery in a science assessment for secondary students with LD (Shelton, 2012) found no difference between students who received the accommodation and those who did not.
  • Research was conducted on the use of recorded oral delivery compared to braille in a social studies assessment for secondary students with a visual impairment (Erin, 2006). Results indicated recorded oral delivery did not provide a differential advantage over braille in student performance.
  • Five studies compared recorded oral delivery and live oral delivery. Results from all four studies found no difference in secondary students’ performance across the two modes on mathematics (Calhoon et al., 2000; Hyunh et al., 2004), reading (Harris, 2008) and science (McMahon et al., 2016) assessments. However, all these studies found an increased performance with either form of the oral delivery accommodation over no accommodation. One study found that the script, inflection, and tone were standardized when prerecorded oral delivery was used when compared to live delivery (human read aloud) helped eliminate construct variance (Shelton, 2012). 

What perceptions do students and teachers have about recorded oral delivery? Four studies touched on how teachers and students perceived recorded oral delivery. 

  • One study examined teacher perceptions of recorded oral delivery for secondary students with reading difficulties on a science assessment. The study found that teachers believed the prerecorded oral delivery of an assessment was more efficient and more feasible than a live oral delivery of an assessment (McMahon et al., 2016).
  • Mixed results were found on student perceptions of recorded oral delivery. One study found that perceptions of secondary students with LD were generally positive or neutral on a science assessment (Shelton, 2012). The results from a second study found that elementary students with various disabilities preferred using the accommodation over not using the accommodation in an ELA assessment because it could remove some print reading barriers (Kosciolek & Ysseldyke, 2000).
  • One study (Erin et al., 2016) examined perceptions of the recorded oral delivery accommodation compared to braille on a social studies exam for secondary students who had a visually impairment. There were mixed findings. Some students preferred recorded oral delivery while others preferred braille. Some students who preferred the recorded oral delivery perceived it to be a quicker method to complete the exam, while those who preferred braille liked that they could read at their own pace.

What have we learned overall? Overall, research on the recorded oral delivery of assessments provides mixed results on its effectiveness for students with various disabilities across grade levels on the ELA and mathematics assessments. Based on the findings of just two studies, no differences were found in secondary students’ performance on science and social studies assessments when they used the recorded oral delivery accommodation. The standardization of recorded oral delivery accommodation has proven to have potential benefits such as removing construct variance around script, tone, speed, and inflection compared to live oral delivery methods. Recorded oral delivery was also generally preferred by both students and teachers when compared to no provision of oral delivery. There has been little research on the impact of the quality of recordings for oral delivery on student performance, and there may be a need for additional research in this area; however, prerecorded audio is not used as much as it once was due to the shift to online assessments that provide oral delivery through the use of text-to-speech technology.

References

  • Calhoon, M. B., Fuchs, L. S., & Hamlett, C. L. (2000). Effects of computer-based test accommodations on mathematics performance assessments for secondary students with learning disabilities. Learning Disability Quarterly, 23(4), 271–282. https://doi.org/10.2307/1511349

  • Erin, J. N., Hong, S., Schoch, C., & Kuo, Y. (2006). Relationships among testing medium, test performance, and testing time of high school students who are visually impaired. Journal of Visual Impairment & Blindness, 100(9), 523–532. https://doi.org/10.1177/0145482x0610000904

  • Harris, L. W. S. (2008). Comparison of student performance between teacher read and CD-ROM delivered modes of test administration of English language arts tests. Dissertation Abstracts International: Section A. Humanities and Social Sciences, 60(07). http://search.proquest.com/docview/304458812/abstract

  • Helwig, R., Rozek-Tedesco, M. A., & Tindal, G. (2002). An oral versus standard administration of a large-scale mathematics test. The Journal of Special Education, 36(1), 39–47.

  • Huynh, H., Meyer, J. P., & Gallant, D. J. (2004). Comparability of student performance between regular and oral administrations for a high-stakes mathematics test. Applied Measurement in Education, 17(1), 39–57. https://doi.org/10.1207/s15324818ame1701_3

  • Kosciolek, S., & Ysseldyke, J. E. (2000). Effects of a reading accommodation on the validity of a reading test (Technical Report No. 28). National Center on Educational Outcomes. http://www.cehd.umn.edu/nceo/OnlinePubs/Technical28.htm

  • Laitusis, C. C. (2010). Examining the impact of audio presentation on tests of reading comprehension. Applied Measurement in Education, 23(2), 153–167. https://doi.org/10.1080/08957341003673815

  • McMahon, D., Wright, R., Cihak, D. F., Moore, T. C., & Lamb, R. (2016). Podcasts on mobile devices as a read-aloud testing accommodation in middle school science assessment. Journal of Science Education and Technology, 25(2), 263–273. https://doi.org/10.1007/s10956-015-9591-3

  • Schnirman, R. K. (2005). The effect of audiocassette presentation on the performance of students with and without learning disabilities on a group standardized math test. Dissertation Abstracts International: Section A. Humanities and Social Sciences, 66(06). http://search.proquest.com/docview/305454672/abstract

  • Shelton, A. (2012). Comparing the performance and preference of students experiencing a reading aloud accommodation to those who do not on a virtual science assessment. Dissertation Abstracts International: Section A. Humanities and Social Sciences, 73(10). http://search.proquest.com/docview/1022482368/abstract

  • Snyder, J. (2010). Audio adapted assessment data: Does the addition of audio to written items modify the item calibration? Dissertation Abstracts International: Section A. Humanities and Social Sciences, 71(05). http://search.proquest.com/docview/305243465/abstract

  • Tindal, G. (2002). Accommodating mathematics testing using a videotaped, read-aloud administration. Council of Chief State School Officers. http://eric.ed.gov/?id=ED473011

Attribution

All rights reserved. Any or all portions of this document may be reproduced and distributed without prior permission, provided the source is cited as:

  • Goldstone, L., Hendrickson, K., Lazarus, S. S., & Hinkle, A. R. (2022). Recorded oral delivery: Research (NCEO Accommodations Toolkit #17a). National Center on Educational Outcomes.

The Center is supported through a Cooperative Agreement (#H326G210002) with the Research to Practice Division, Office of Special Education Programs, U.S. Department of Education. The Center is affiliated with the Institute on Community Integration at the College of Education and Human Development, University of Minnesota. Consistent with EDGAR §75.62, the contents of this report were developed under the Cooperative Agreement from the U.S. Department of Education, but do not necessarily represent the policy or opinions of the U.S. Department of Education or Offices within it. Readers should not assume endorsement by the federal government. Project Officer: David Egnor