A Comparative Study of Phoneme- and Word-Based Learning of English Words Presented to the Skin



Past research has demonstrated that speech communication on the skin is entirely achievable. However, there is still no definitive conclusion on the best training method that minimizes the time it takes for users to reach a prescribed performance level with a speech communication device. The present study reports the design and testing of two learning approaches with a system that translates English phonemes to haptic stimulation patterns (haptic symbols). With the phoneme-based learning approach, users learned the haptic symbols associated with the phonemes before attempting to acquire words made up of the phonemes. With the word-based approach, users learned words on day one. Two experiments were conducted with the two learning approaches, each employing twelve participants who spent 100 minutes each learning 100 English words made up of 39 phonemes. Results in terms of the total number of words learned show that performance levels vary greatly among the individuals tested (with the best learners in both methods achieving word-recognition scores >90%-correct on a 100-word vocabulary), both approaches are feasible for successful acquisition of word through the skin, and the phoneme-based approach provides a more consistent path for learning across users in a shorter period of time.

Related Publications

All Publications

ISMAR - July 29, 2021

Instant Visual Odometry Initialization for Mobile AR

Alejo Concha, Michael Burri, Jesus Briales, Christian Forster, Luc Oth

ICSA - November 6, 2019

Auralization systems for simulation of augmented reality experiences in virtual environments

Peter Dodds, Sebastià V. Amengual Garí, W. Owen Brimijoin, Philip W. Robinson

Journal of the Audio Engineering Society - July 20, 2021

Six-Degrees-of-Freedom Parametric Spatial Audio Based on One Monaural Room Impulse Response

Johannes M. Arend, Sebastià V. Amengual Garí, Carl Schissler, Florian Klein, Philip W. Robinson

ACM Transactions on Applied Perception Journal (ACM TAP) - September 16, 2021

Evaluating Grasping Visualizations and Control Modes in a VR Game

Alex Adkins, Lorraine Lin, Aline Normoyle, Ryan Canales, Yuting Ye, Sophie Jörg

To help personalize content, tailor and measure ads, and provide a safer experience, we use cookies. By clicking or navigating the site, you agree to allow our collection of information on and off Facebook through cookies. Learn more, including about available controls: Cookies Policy