Learning with Our Ears: Using Context-Supported Geoscience Data Sonification to Engage Public Audiences in Informal Learning Environments

Most exhibits in informal learning environments (ILEs) like museums, science centers and aquariums use visual display techniques such as graphs, charts, and computer-generated visualizations to provide quantitative information. However, these representations may be inaccessible and/or uninteresting to visitors who have low graph-reading literacy, or who avoid complex quantitative displays based on past experience, as well as those who are blind or have low vision (BLV) or other print-related disabilities. In the NSF-funded “Accessible Oceans” project, we researched the feasibility of using auditory displays to represent ocean data in ILEs to engage more visitors in the exploration of ocean phenomena. Music, sound effects, and environmental sounds are sometimes used in ILE exhibits, but these audio methods are inadequate for conveying quantitative information. We have developed prototype auditory displays using authentic data from the NSF Ocean Observatories Initiative (OOI) to describe processes such as gas exchange across the air-sea interface and the impact of storms on the upper ocean. Each display consists of a context-setting narration, an audio “key” and a data sonification audio track ,all designed to meet tiered learning objectives. Following a user-centered design process, auditory displays were tested at all stages of development with subject-matter experts, BLV students and adults, as well as with the general public in ILEs. Undergraduate and graduate students were also engaged in the design process. Auditory display prototypes will be demonstrated, and we will report on lessons learned and results from a summative assessment. We expect this research will contribute new strategies and resources for representing quantitative information that can be applied across other STEM disciplines including weather and climate, providing equitable access to more ILE visitors.