Mid-Air Haptics for Virtual Buttons in Spatial Games

Implementing tactile click feedback on virtual holographic buttons floating in mid-air requires bridging the gap between intangible light projections and physical human perception. Spatial game developers achieve this through a combination of non-contact ultrasound projection, wearable tactile actuators, cross-modal sensory substitution, and advanced spatial interaction design. This article breaks down the primary hardware technologies and software methods used to simulate the sensation of a physical button press on mid-air holograms.

1. Acoustic Radiation Force (Focused Ultrasound)

The most prominent method for true touchless mid-air tactile feedback is focused ultrasound arrays, pioneered by companies like Ultraleap.

  • Mechanism: An array of ultrasonic transducers emits high-frequency sound waves (typically around 40 kHz) out of the human hearing range.
  • Focal Points: By carefully adjusting the phase and timing of each transducer, the sound waves converge at a precise 3D coordinate in space, creating an acoustic focal point.
  • Tactile Sensation: This convergence generates localized acoustic radiation pressure against the user's bare skin. By rapidly modulating the pressure wave (typically between 150 Hz and 250 Hz, where human Pacinian corpuscles are most sensitive), the system produces a discernible "pulse" or "tap" that registers as a physical button click.

2. Wearable Actuators and Haptic Peripherals

When unencumbered bare-hand interaction is not strictly required, wearable hardware provides the sharpest and most responsive click feedback.

  • Linear Resonant Actuators (LRAs) and Voice Coil Actuators (VCAs): Mounted on rings, thimbles, or haptic gloves, these actuators vibrate along a single axis to produce sharp, low-latency transient pulses identical to modern smartphone haptics.
  • Piezoelectric Actuators: Ultra-thin and fast, piezo-based elements can deform instantly to deliver micro-clicks and surface texture simulations directly onto the fingertips.
  • Microfluidics and Pneumatics: Advanced haptic gloves use micro-bladders that rapidly inflate or deflate using air or liquid, physically applying pressure to the finger pad the instant a virtual button bottom-outs.

3. Pseudo-Haptics and Sensory Cross-Modality

The human brain relies heavily on visual and auditory signals to construct tactile perception. Spatial game developers exploit this cross-modal plasticity—termed "pseudo-haptics"—to trick the nervous system into perceiving tactile resistance and confirmation without physical stimulation.

  • Visual Displacement and Elasticity: When the user's hand intersects a holographic button, the button visually depresses along its actuation axis. When it hits the actuation threshold, snapping animations, color shifts, and glow bursts immediately signal state completion.
  • Hand Decoupling / Visual Arrest: Some systems briefly freeze or artificially slow down the rendered virtual hand model relative to the user's actual physical hand at the actuation threshold. This mismatch tricks the brain into assuming the hand encountered physical resistance.
  • Spatial Audio Substitution: A high-fidelity, spatialized acoustic cue—such as a deep mechanical "thud" or high-frequency "snap"—is played at zero latency from the exact coordinate of the button. Sharp, crisp audio drastically increases the perceived solidity of an empty-air interaction.

4. Controller-Borne Spatial Interaction

In mainstream spatial computing (such as Meta Quest, Apple Vision Pro with accessories, or PlayStation VR2), spatial controllers act as the physical intermediary.

  • Spatial Raycast / Surface Boundary Triggers: Optical tracking monitors the controller's exact coordinate. As the virtual tip of the controller or an extended laser enters the bounding volume of the holographic button, a sub-millisecond actuation pulse fires via the controller's internal motors.
  • Two-Stage Clicks: Developers often program a faint vibration when the virtual object is lightly touched (hover/contact), followed by a sharp impulse once pushed past a specific depth threshold (actuation), mimicking a mechanical microswitch.

5. Aerodynamic Vortex Actuation (Air Jets)

Pneumatic systems project focused rings of air toward the user's hands from stationary external units.

  • Operation: High-speed air nozzles or voice-coil-driven diaphragms fire tight vortex rings of displaced air across several feet of open space.
  • Effect: When the user's finger reaches the coordinate of a holographic button, an air pulse collides with the hand, delivering a localized burst of kinetic energy that mimics a soft mechanical response. While less precise than ultrasound, air jets require no wearable components.