Web Audio Haptics
Tutorial
on Haptics
with Web Audio
2nd Web Audio Conference 2016
Georgia Tech, Atlanta, USA, April 6
Christian Frisson, Thomas Pietrzak, Siyan Zhao, Zachary Schwemler, Ali Israr
Team
Tutorial material
Slides including Web Audio patches available on:
http://WebAudioHaptics.github.io
Clone repositories from:
https://github.com/WebAudioHaptics
Outline
- Software: WebPd, NexusUI
- Hardware: actuators
- Exploration: tactile illusions
Software
PureData
A desktop app for patch-based visual programming of audio/video/sensor data flows
Main author: Miller Puckette
http://puredata.info
WebPd
PureData patches running on a browser with Web Audio
Main authors: Sébastien Piquemal, Chris McCormick
https://github.com/sebpiq/WebPd
forked: https://github.com/WebAudioHaptics/WebPd
NexusUI
JavaScript toolkit of HTML5 audio interfaces
Main authors: Ben Taylor, Jesse Allison
http://www.nexusosc.com
https://github.com/lsu-emdm/nexusUI
Activity
Test WebPd and NexusUI
Turn on amplifications and fiddle with frequencies!
Activity
NexusUI controls not showing?
Reload the slide
WebPd not outputing sound?
Open your browser's console/inspector to check for messages.
Test if linear ramps are supported by your browser: http://webaudiohaptics.github.io/WAAOffsetNode/waatest/
Hardware
Vibrating DC Motors
Embedded in smartphones
High torque and servo motors
Used for force or position control (robotics, haptics)
Linear Resonant Actuators
Voice Coil Actuators
Electromagnetic Actuators
Subwoofers
Butt kickers
Tactile transducers
More AC Actuators
Piezo actuators
Electroactive polymers
Muscle stimulators
WebAudioHaptics Kit
Siyan Zhao, Zachary Schwemler, Adam Fritz, and Ali Israr. "Stereo Haptics: Designing Haptic Interactions using Audio Tools." In Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '16). DOI=10.1145/2839462.2854120
Activity
Plug the WebAudioHaptics kit
Activity
Play with the WebAudioHaptics kit
Turn on amplifications and fiddle with frequencies!
Exploration
Body locations
Tactile illusions
Apparent Tactile Motion
Saltation
Apparent Tactile Motion
Control parameters
Study
SOA = 0.28 * duration + 60.7
S. Zhao, A. Israr and R. Klatzky, "Intermanual apparent tactile motion on handheld tablets,"
IEEE World Haptics Conference (WHC) 2015, doi: 10.1109/WHC.2015.7177720
Activity
Explore the effects of parameters
Saltation
Activity (optional)
Let's code it yourself now!
Thanks for your participation!
Slides including Web Audio patches will remain on:
http://WebAudioHaptics.github.io
Clone repositories from:
https://github.com/WebAudioHaptics