In the future, the interface and interaction should not be constrained to 2D display and visual elements. As one of many future interactive directions, spatial interaction is the most tangible method that integrates different sensory I/O, bringing the usability and user experience to the next level.
HoloLens stands for the Mixed Reality glasses released by Microsoft. With a bundle of sensors in front of the glasses, HoloLens can project virtual elements in physical spots (spatial awareness), recognizing the hands and the basic hand gestures that allow users to interact spatially without additional remotes.
In this section, I tend to build the resizing interaction based on physical gestures (dragging & tapping) to see how the 3D object in the spatial interface has been precisely manipulated.
The outcome shows as follows:
- The object can be zoomed in three dimensions by grasping the handles on the edges.
- When the handle is active, the number panel automatically pops up and follows the handle.
- On the number panel, the current length of the configuring dimension will update in real-time.
- The panel is interactable. It'll call the floating numpad that gives precise numbers directly.
Inspired by default resizing interaction in MRTK3 (Mixed Reality Toolkit 3) The primary controllers are divided into three levels:
HandleController - The detailed interaction on each handle
BoxController - The auto-snap box will snap on objects dynamically
BoundsController - The Resizing logic controller
