Hearing a circle: An exploratory study of accessible sonification for young children with blindness and low vision

Abstract

This article describes a study of educational outcomes for 0- to 8-year-old children with blindness and low vision (BLV) who are learning sonification concepts. Children with BLV experience barriers to accessing education and careers in Science, Technology, Engineering and Mathematics (STEM), fields which traditionally rely heavily on visual representation of information. There is growing awareness of the potential of sonification, a technology to represent data and information in non-speech audio, to improve education access. While early learning of assistive technology skills is deemed essential for equity of access to education across the curriculum, children are generally not introduced to the concept of sonification at school until at academic level in secondary or tertiary education. Little is known about how young children with BLV engage with this promising technology. First, ‘CosmoBally on Sonoplanet’ is introduced, an accessible, educational game application for iPads and Android tablets. Then findings are shared from an anonymous online survey that collected formal responses from users of this app, using a combination of Likert-type scale and open-ended questions. The majority of the 17 respondents were (specialist) educators, and five of the respondents identified as having BLV. The survey investigated respondents’ perceptions of the capabilities of young children with BLV in using basic sonification in ‘CosmoBally on Sonoplanet’ to identify shapes – including a circle – to orientate in a digital grid and to create drawings on a touch screen. Results suggest that young children with BLV can learn sonification skills and additionally may build relevant non-sonification skills during this learning process. This article aims to provide a first insight into best practice around early learning of sonification as a potential tool for increased access and inclusion of children with BLV to STEM subjects in school.

Keywords

Accessibility blindness education gamification sonification STEM vision impairment young children

Get full access to this article

View all access options for this article.

References

Alonso-Arevalo

M. A.

Shelley

Hermes

Hollowood

Pettitt

Sharples

Kohlrausch

. (2012). Curve Shape and Curvature Perception Through Interactive Sonification. ACM Transactions on Applied Perception, 9(4), 1–19. https://doi.org/10.1145/2355598.2355600

Arcand

(2022). Chandra’s accessible universe: From sight to sound & touch [2nd Workshop on Astronomy Beyond the Common Senses for Accessibility and Inclusion]. Revista Mexicana de Astronomía y Astrofísica Serie de Conferencias (RMxAC), 54, 53–56. https://doi.org/10.22201/ia.14052059p.2022.54.11

Ballyland. (n.d.). https://www.sonokids.org

Bonne

Gupta

Krawczyk

Masters

(2018). Tactile Universe makes outreach feel good. Astronomy & Geophysics, 59(1), 130–133. https://doi.org/10.1093/astrogeo/aty028

Bower

Bellona

Roberts

Smith

L. M.

(2021). Accessible oceans: Exploring ocean data through sound. https://accessibleoceans.whoi.edu/

Caspersz

Stasinska

(2015). Can we teach effective listening? An exploratory study. Journal of University Teaching & Learning Practice, 12(4), 1–13. https://doi.org/10.53761/1.12.4.2

Cooke

(2022, August 17). Scientists are turning data into sound to listen to the whispers of the universe (and more). The Conversation. https://theconversation.com/scientists-are-turning-data-into-sound-to-listen-to-the-whispers-of-the-universe-and-more-188699#

Damsma

Norgaard

J. T.

Cashmore

(2023, June 26–30). Accessible sonification design for young learners [Conference session]. In: Sonification for the Masses: Proceedings of the 28th International Conference on Auditory Display (ICAD2023), Norrköping, Sweden (pp. 280–282). https://hdl.handle.net/1853/72890

Data Sonification Archive. (n.d.). https://sonification.design/

10.

Desmos. (n.d.). https://www.desmos.com

11.

Diaz Merced

. (2022, November 17). Sonification: A tool for research, outreach and inclusion in space sciences [panel discussion]. Webinar United Nations Office of Outer Space Affairs. https://www.unoosa.org/oosa/en/ourwork/space4personswithdisabilites/sonification2022.html

12.

Dietz

Landay

J. A.

Gweon

(2019). Building blocks of computational thinking: Young children’s developing capacities for problem decomposition. Proceedings 41st Annual Meeting of the Cognitive Science Society (pp. 1647–1653).

13.

Fanshawe

M. J.

(2022). Barriers and enablers to participation in learning and future employability for students with blindness and low vision in Australian mainstream secondary schools: A bioecological systems perspective. University of Southern Queensland.

14.

Foran

Cooke

Hannam

(2022). The power of listening to your data: Opening doors and enhancing discovery using sonification. 2nd Workshop on Astronomy beyond the Common Senses for Accessibility and Inclusion, Revista Mexicana de Astronomía y Astrofísica Serie de Conferencias (RMXAC), 54, 1–8.

15.

Harrison

Trayford

Harrison

Bonne

. (2022). Audio universe: tour of the solar system. Astronomy & Geophysics, 63(2), 2.38–2.40. https://doi.org/10.1093/astrogeo/atac027

16.

Hayes

Proulx

M. J.

(2023). Turning a blind eye? Removing barriers to science and mathematics education for students with visual impairments. British Journal of Visual Impairment, 42, 544–556. https://doi.org/10.1177/02646196221149561

17.

Hewett

Douglas

McLinden

James

Brydon

Chattaway

Cobb

Keil

Raisanen

Sutherland

Taylor

(2022). Curriculum framework for children and young people with vision impairment (CFVI): Defining specialist skills development and best practice support to promote equity, inclusion and personal agency. RNIB.

18.

Huang

Siu

Hanocka

Gingold

(2023). ShapeSonic: Sonifying fingertip interactions for non-visual virtual shape perception. SA ’23: SIGGRAPH Asia 2023 Conference Papers, Article No. 80. https://doi.org/10.1145/3610548.3618246

19.

Kennedy

J. M.

(1993). Drawing & the blind. Pictures to touch. Yale University Press.

20.

Kramer

Walker

B. N.

Bonebright

Cook

Flowers

Miner

Neuhoff

(1999). The sonification report: Status of the field and research agenda [Report prepared for the National Science Foundation by members of the International Community for Auditory Display]. International Community for Auditory Display ICAD.

21.

McLinden

Douglas

Cobb

Hewett

Ravenscroft

(2016). ‘Access to learning’ and ‘learning to access’: Analysing the distinctive role of specialist teachers of children and young people with vision impairments in facilitating curriculum access through an ecological systems theory. British Journal of Visual Impairment, 34(2), 177–195. https://doi.org/10.1177/0264619616643180

22.

Misdariis

Pauletto

Bonne

Harrison

Meredith

Zanella

(2023, June 26–30). The Audible universe workshop: An interdisciplinary approach to the design and evaluation of tools for astronomical data sonification. Proceedings of the 28th International Conference on Auditory Display (ICAD2023). https://doi.org/10.21785/icad2023.2124

23.

Polo

Sevillano

(2019). Musical Vision: An interactive bio-inspired sonification tool to convert images into music. Journal on Multimodal User Interfaces, 13, 231–243. https://doi.org/10.1007/s12193-018-0280-4

24.

Powell

C. S.

(2023, June 19). How sounds can turn us on to the wonders of the universe [MIT Technology Review]. Massachusetts Institute of Technology. https://www.technologyreview.com/2023/06/19/1074049/universe-sonification/amp

25.

Radecki

Bujacz

Skulimowski

Strumiłł

(2020). Interactive sonification of images in serious games as an education aid for visually impaired children. British Journal of Educational Technology, 51(2), 473–497. https://doi.org/10.1111/bjet.12852

26.

Russo

Gernon

T. M.

Santaguida

Hincks

T. K.

(2024). Improving Earth science communication and accessibility with data sonification. Nature Reviews Earth & Environment, 5, 1–3. https://doi.org/10.1038/s43017-023-00512-y

27.

SAS Graphics Accelerator. (n.d.). https://support.sas.com/software/products/graphics-accelerator/index.html

28.

Scaletti

(2017, June 20). Why sonification is a joke [Keynote address]. 23rd International Conference of Auditory Display, The Pennsylvania State University, State College, PA, USA [Video]. YouTube. https://www.youtube.com/watch?v=T0qdKXwRsyM

29.

SenseMath. (n.d.). https://www.visio.org/en-gb/professional/expertise/onderzoeken/digitale-ontwikkelingen-innovaties/sensemath

30.

Smith

L. M.

Bower

Roberts

Bellona

(2023). Expanding access to ocean science through inclusively designed data sonifications. Oceanography, 36(4), 96–101. https://doi.org/10.5670/oceanog.2024.124

31.

Yang

(2023). A systematic review of integrating computational thinking in early childhood education. Computers and Education Open, 4, 100122.

32.

Supper

(2015). Data karaoke: Sensory and bodily skills in conference presentations. Science as Culture, 24(4), 436–445. https://doi.org/10.1080/09505431.2015.1052390

33.

Targett

Fernström

(2003, July 6–9). Audio games: Fun for all? All for fun? [Conference session]. Proceedings of the 2003 international conference on auditory displays, Boston, MA, United States.

34.

Tomlinson

B. J.

Batterman

Chew

Y. C.

Henry

Walker

B. N.

(2016). Exploring auditory graphing software in the classroom: The effect of auditory graphs on the classroom environment. ACM Transactions on Accessible Computing, 9(1), 1–27. https://doi.org/10.1145/2994606

35.

United Nations Office of Outer Space Affairs. (2023, April). Sonification: A tool for research, outreach and inclusion in space sciences [Special Report by the Space for People with Disabilities Project]. https://www.unoosa.org/documents/pdf/Space4PersonswithDisabilites/UNOOSA_Special_Report_on_Sonification_2023.pdf

36.

Vandergrift

(2004). Listening to learn or learning to listen? Annual Review of Applied Linguistics, 24, 3–25. https://doi.org/10.1017/S0267190504000017

37.

Walker

B. N.

(2019). Sonification. Diagram Center, Benetech. http://diagramcenter.org/diagram-reports/diagram-report-2019/sonification.html

38.

Walker

B. N.

Kramer

(2005). Mappings and metaphors in auditory displays: An experimental assessment. ACM Transactions on Applied Perception, 2(4), 407–412. https://doi.org/10.1145/1101530.1101534

39.

Wing

J. M.

(2006). Computational thinking. Communications of the ACM, 49(3), 33–35. https://doi.org/10.1145/1118178.1118215

40.

Zanella

Harrison

C. M.

Lenzi

Cooke

Damsma

Fleming

S. W.

(2022). Sonification and sound design for astronomy research, education and public engagement. Nature Astronomy, 6, 1241–1248. https://doi.org/10.1038/s41550-022-01721-z