Publication

DodecaPen: Accurate 6DoF Tracking of a Passive Stylus

ACM Symposium on User Interface Software and Technology (UIST)


Abstract

We propose a system for real-time six degrees of freedom(6DoF) tracking of a passive stylus that achieves sub-millimeter accuracy, which is suitable for writing or drawing in mixed reality applications. Our system is particularly easy to implement, requiring only a monocular camera, a 3D printed dodecahedron, and hand-glued binary square markers. The accuracy and performance we achieve are due to model-based tracking using a calibrated model and a combination of sparse pose estimation and dense alignment. We demonstrate the system performance in terms of speed and accuracy on a number of synthetic and real datasets, showing that it can be competitive with state-of-the-art multi-camera motion capture systems. We also demonstrate several applications of the technology ranging from 2D and 3D drawing in VR to general object manipulation and board games.

Related Publications

All Publications

Neural Supersampling for Real-time Rendering

Lei Xiao, Salah Nouri, Matt Chapman, Alexander Fix, Douglas Lanman, Anton Kaplanyan

ACM SIGGRAPH - August 17, 2020

Holographic Optics for Thin and Lightweight Virtual Reality

Andrew Maimone, Junren Wang

ACM SIGGRAPH - July 3, 2020

The Eyes Have It: An Integrated Eye and Face Model for Photorealistic Facial Animation

Gabriel Schwartz, Shih-En Wei, Te-Li Wang, Stephen Lombardi, Tomas Simon, Jason Saragih, Yaser Sheikh

ACM SIGGRAPH - July 3, 2020

Differences between oculomotor and perceptual artifacts for temporally limited head mounted displays

Alexander Goettker, Kevin J. MacKenzie, T. Scott Murdison

SID Display Week - June 2, 2020

To help personalize content, tailor and measure ads, and provide a safer experience, we use cookies. By clicking or navigating the site, you agree to allow our collection of information on and off Facebook through cookies. Learn more, including about available controls: Cookies Policy