Research Area
Year Published

109 Results

May 4, 2020

SeCoST: Sequential Co-Supervision for Weakly Labeled Audio Event Detection

International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

Weakly supervised learning algorithms are critical for scaling audio event detection to several hundreds of sound categories. Such learning models should not only disambiguate sound events efficiently with minimal class-specific annotation but also be robust to label noise, which is more apparent with weak labels instead of strong annotations. In this work, we propose a new framework for designing learning models with weak supervision by bridging ideas from sequential learning and knowledge distillation.

By: Anurag Kumar, Vamsi Krishna Ithapu

April 24, 2020

Chasm: A Screw Based Expressive Compact Haptic Actuator

ACM Conference on Human Factors in Computing Systems (CHI)

We present a compact broadband linear actuator, Chasm, that renders expressive haptic feedback on wearable and handheld devices. Unlike typical motor-based haptic devices with integrated gearheads, Chasm utilizes a miniature leadscrew coupled to a motor shaft, thereby directly translating the high-speed rotation of the motor to the linear motion of a nut carriage without an additional transmission.

By: Pornthep Preechayasomboon, Ali Israr, Majed Samad

April 20, 2020

Direction of Arrival Estimation in Highly Reverberant Environments Using Soft Time-Frequency Mask

IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA)

A recent approach to improving the robustness of sound localization in reverberant environments is based on pre-selection of time-frequency pixels that are dominated by direct sound. This approach is equivalent to applying a binary time-frequency mask prior to the localization stage. Although the binary mask approach was shown to be effective, it may not exploit the information available in the captured signal to its full extent. In an attempt to overcome this limitation, it is hereby proposed to employ a soft mask instead of the binary mask.

By: Vladimir Tourbabin, Jacob Donley, Boaz Rafaely, Ravish Mehra

April 9, 2020

Environment-aware reconfigurable noise suppression

International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

The paper proposes an efficient, robust, and reconfigurable technique to suppress various types of noises for any sampling rate. The theoretical analyses, subjective and objective test results show that the proposed noise suppression (NS) solution significantly enhances the speech transmission index (STI), speech intelligibility (SI), signal-to-noise ratio (SNR), and subjective listening experience.

By: Jun Yang, Joshua Bingham

March 28, 2020

Communicating Socio-Emotional Sentiment Through Haptic Messages

IEEE Haptics Symposium

We explore how a custom-built, low degree-of-freedom, wearable haptic display may mediate the encoding and decoding of a set of complex socio-emotional messages that is sent and received by strangers, intimate partners, and even the same individual a week later.

By: Xi Laura Cang, Ali Israr

March 21, 2020

Evaluating Virtual Reality Experiences Through Participant Choices

IEEE Conference on Virtual Reality and 3D User Interfaces

When building virtual reality applications teams must choose between different configurations of the hardware and/or software aspects, and other factors, of the experience. In this paper we extend a framework for assessing how these factors contribute to quality of experience in an example evaluation. We consider how four factors related to avatar expressiveness affect quality of experience: Eye Gaze, Eye Blinking, Mouth Animation, and Microexpressions.

By: María Murcia López, Tara Collingwoode-Williams, William Steptoe, Raz Schwartz, Timothy Loving, Mel Slater

February 3, 2020

Design of Deployable Soft Robots Through Plastic Deformation of Kirigami Structures

IEEE Robotics and Automation Letters

Kirigami-patterned mechanisms are an emergent class of deployable structure that are easy to fabricate and offer the potential to be integrated into deployable robots. In this letter, we propose a design methodology for robotic kirigami structures that takes into consideration the deformation, loading, and stiffness of the structure under typical use cases.

By: Audrey Sedal, Amirhossein H. Memar, Tianshu Liu, Yigit Mengüç, Nick Corson
Areas: AR/VR

January 1, 2020

Designing Safe Spaces for Virtual Reality

Ethics in Design and Communication

Virtual Reality (VR) designers accept the ethical responsibilities of removing a user’s entire world and superseding it with a fabricated reality. These unique immersive design challenges are intensified when virtual experiences become public and socially-driven. As female VR designers in 2018, we see an opportunity to fold the language of consent into the design practice of virtual reality—as a means to design safe, accessible, virtual spaces.

Publication will be made available in 2020.

By: Michelle Cortese, Andrea Zeller

December 16, 2019

Study of 3D Virtual Reality Picture Quality

IEEE Journal of Selected Topics in Signal Processing

Virtual Reality (VR) and its applications have attracted significant and increasing attention. However, the requirements of much larger file sizes, different storage formats, and immersive viewing conditions pose significant challenges to the goals of acquiring, transmitting, compressing and displaying high quality VR content. Towards meeting these challenges, it is important to be able to understand the distortions that arise and that can affect the perceived quality of displayed VR content. It is also important to develop ways to automatically predict VR picture quality. Meeting these challenges requires basic tools in the form of large, representative subjective VR quality databases on which VR quality models can be developed and which can be used to benchmark VR quality prediction algorithms. Towards making progress in this direction, here we present the results of an immersive 3D subjective image quality assessment study.

By: Meixu Chen, Yize Jin, Todd Goodall, Xiangxu Yu, Alan C. Bovik
Areas: AR/VR

December 15, 2019

VPS Tactile Display: Tactile Information Transfer of Vibration, Pressure, and Shear

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT)

One of the challenges in the field of haptics is to provide meaningful and realistic sensations to users. While most real world tactile sensations are composed of multiple dimensions, most commercial product only include vibration as it is the most cost effective solution. To improve on this, we introduce VPS (Vibration, Pressure, Shear) display, a multi-dimensional tactile array that increases information transfer by combining Vibration, Pressure, and Shear similar to how RGB LED combines red, blue, and green to create new colors.

By: Lawrence H. Kim, Pablo Castillo, Sean Follmer, Ali Israr
Areas: AR/VR