Coding Tactile Symbols for Phonemic Communication

Conference on Human Factors in Computing Systems (CHI)


We present a study to examine one’s learning and processing capacity of broadband tactile information, such as that derived from speech. In Study 1, we tested a user’s capability to recognize tactile locations and movements on the forearm in the presence of masking stimuli and determined 9 distinguishable tactile symbols. We associated these symbols to 9 phonemes using two approaches, random and articulation associations. Study 2 showed that novice participants can learn both associations. However, performance for retention, construction of words and knowledge transfer to recognize unlearned words was better with articulation association. In study 3, we trained novel participants to directly recognize words before learning phonemes. Our results show that novel users can retain and generalize the knowledge to recognize new words faster when they were directly train on words. Finally, Study 4 examined optimal presentation rate for the tactile symbols without compromising learning and recognition rate

Related Publications

All Publications

ACM Transactions on Applied Perception Journal (ACM TAP) - September 16, 2021

Evaluating Grasping Visualizations and Control Modes in a VR Game

Alex Adkins, Lorraine Lin, Aline Normoyle, Ryan Canales, Yuting Ye, Sophie Jörg

IEEE WHC - July 7, 2021

Learning Vibes: Communication Bandwidth of a Single Wrist-Worn Vibrotactile Actuator

Elyse D. Z. Chase, Ali Israr, Pornthep Preechayasomboon, Sarah Sykes, Aakar Gupta, Jessica Hartcher-O’Brien

ACM CHI Virtual Conference on Human Factors in Computing Systems (CHI) - May 8, 2021

Armstrong: An Empirical Examination of Pointing at Non-Dominant Arm-Anchored UIs in Virtual Reality

Zhen Li, Joannes Chan, Joshua Walton, Hrvoje Benko, Daniel Wigdor, Michael Glueck

CHI - May 8, 2021

Understanding, Detecting and Mitigating the Effects of Coactivations in Ten-Finger Mid-Air Typing in Virtual Reality

Conor R. Foy, John J. Dudley, Aakar Gupta, Hrvoje Benko, Per Ola Kristensson

To help personalize content, tailor and measure ads, and provide a safer experience, we use cookies. By clicking or navigating the site, you agree to allow our collection of information on and off Facebook through cookies. Learn more, including about available controls: Cookies Policy