The Comprehension of STEM Graphics via a Multisensory Tablet Electronic Device by Students with Visual Impairments

Abstract

Introduction:

The current work probes the effectiveness of multimodal touch screen tablet electronic devices in conveying science, technology, engineering, and mathematics graphics via vibrations and sounds to individuals who are visually impaired (i.e., blind or low vision) and compares it with similar graphics presented in an embossed format.

Method:

A volunteer sample of 22 participants who are visually impaired, selected from a summer camp and local schools for blind students, were recruited for the current study. Participants were first briefly (∼30 min) trained on how to explore graphics via a multimodal touch screen tablet. They then explored six graphic types (number line, table, pie chart, bar chart, line graph, and map) displayed via embossed paper and tablet. Participants answered three content questions per graphic type following exploration.

Results:

Participants were only 6% more accurate when answering questions regarding an embossed graphic as opposed to a tablet graphic. A paired-samples t test indicated that this difference was not significant, t(14) = 1.91, p = .07. Follow-up analyses indicated that presentation medium did not interact with graphic type, F(5, 50) = 0.43, p = .83, nor visual ability, F(1, 13) = 0.00, p = .96.

Discussion:

The findings demonstrate that multimodal touch screen tablets may be comparable to embossed graphics in conveying iconographic science and mathematics content to individuals with visual impairments, regardless of the severity of impairment. The relative equivalence in response accuracy between mediums was unexpected, given that most students who participated were braille readers and had experience reading embossed graphics, whereas they were introduced to the tablet the day of testing.

Implications for practitioners:

This work illustrates that multimodal touch screen tablets may be an effective option for general education teachers or teachers of students with visual impairments to use in their educational practices. Currently, preparation of accessible graphics is time consuming and requires significant preparation, but such tablets provide solutions for offering “real-time” displays of these graphics for presentation in class.

Keywords

accessible graphics multimodal feedback tactile feedback vibrations touchscreens STEM education

Get full access to this article

View all access options for this article.

References

Brock

A. M.

Truillet

Oriola

Picard

Jouffrais

(2015). Interactivity improves usability of geographic maps for visually impaired people. Human–Computer Interaction, 30, 156–194.

Craig

J. C.

(1985). Attending to two fingers: Two hands are better than one. Attention, Perception, & Psychophysics, 38, 496–511.

Giudice

N. A.

Palani

H. P.

Brenner

Kramer

K. M.

(2012, October). Learning non-visual graphical information using a touch-based vibro-audio interface. Proceedings of the 14th International ACM SIGACCESS Conference on Computers and Accessibility, Boulder, CO.

Goncu

Marriott

(2011). Gravvitas: Generic multi-touch presentation of accessible graphics. Proceedings of the Human–Computer Interaction INTERACT 2011, Springer, 30–48.

Gorlewicz

J. L.

Burgner

Withrow

T. J.

Webster

R. J.

III . (2014). Initial experiences using vibratory touchscreens to display graphical math concepts to students with visual impairments. Journal of Special Education Technology, 29, 17–25.

Kelly

S. M.

(2009). Use of assistive technology by students with visual impairments: Findings from a national survey. Journal of Visual Impairment & Blindness, 103, 470–480.

Loomis

J. M.

Klatzky

R. L.

Giudice

N. A.

(2012). Sensory substitution of vision: Importance of perceptual and cognitive processing. In Manduchi

Kurniawan

(Eds.), Assistive technology for blindness and low vision (pp. 162–191). Boca Raton, FL: CRC Press.

Macaluso

Maravita

(2010). The representation of space near the body through touch and vision. Neuropsychologia, 48, 782–795.

Mousty

(1986). La iecture de l’écriture braiiie: Patrons d’exploration et fonctions des mains (Dissertation doctorale non-publiée). Bruxelles, Belgium: Université libre de Bruxelles.

10.

O’Modhrain

Giudice

N. A.

Gardner

J. A.

Legge

G. E.

(2015). Designing media for visually-impaired users of refreshable touch displays: Possibilities and pitfalls. IEEE Transactions on Haptics, 8, 248–257.

11.

Pal

Pradhan

Shah

Babu

(2011, March). Assistive technology for vision-impairments: An agenda for the ICTD community. Proceedings of the 20th International Conference Companion on World wide Web, Hyderabad, India.

12.

Pawluk

D. T.

Adams

R. J.

Kitada

(2015). Designing haptic assistive technology for individuals who are blind or visually impaired. IEEE Transactions on Haptics, 8, 258–278.

13.

Raja

M. K.

(2011). The development and validation of a new smartphone based non-visual spatial interface for learning indoor layouts (Unpublished master’s thesis). University of Maine, Orono, MN.

14.

Tennison

J. L.

Gorlewicz

J. L.

(2016). Toward non-visual graphics representations on vibratory touchscreens: Shape exploration and identification. In Bello

Kajimoto

Visell

(Eds.), Haptics: Perception, devices, control, and applications. Eurohaptics. Lecture notes in computer science, vol. 9775 (pp. 384–395).

15.

Ulusoy

(2015). A touch based finger-motion-adaptive control design for braille reading (Doctoral dissertation). Northeastern University, Boston, MA.

16.

ViTAL. (2018). Home. Retrieved from https://www.vital.education

17.

Wong

Gnanakumaran

Goldreich

(2011). Tactile spatial acuity enhancement in blindness: Evidence for experience-dependent mechanisms. Journal of Neuroscience, 31, 7028–7037.

18.

Zhou

Parker

A. T.

Smith

D. W.

Griffin-Shirley

. (2011). Assistive technology for students with visual impairments: Challenges and needs in teachers’ preparation programs and practice. Journal of Visual Impairment & Blindness, 105, 197–210.