Interaction Designer
Screen Shot 2014-10-20 at 2.59.34 pm.png

In-Air Gestures

Favoured Attributes of In-Air Gestures in the Home Environment

Published in the OzChi 2013 Proceedings: Favoured Attributes of In-Air Gestures in the Home Environment . This paper summarises a series of iterative interfaces that explore people's ideal use of multi-modal inputs to control objects in their home environment.

Abstract

The home is an environment filled with an increasing number of fixtures and appliances, from doors and windows to kettles and chargers. Devices for in-air gestural recognition are also increasing in commercial availability. Appropriate attributes that make up natural in-air gestures have yet to be uniformly established, especially in relation to their use in the comfort of the home environment. Three studies were conducted, each informing the focus and construction of a gesture- recognition prototype for the following study. The preferred attributes of in-air gestures were examined; their use in conjunction with other modalities, the motion of in-air gestures, and feedback delay and transition time of an action as instigated by an in-air gesture. Our findings indicate natural actions that precede in-air gestures, topographical correlations between gesture and system response, and a desire for minimal effort. These results can be used as guidelines for the design of in-air gestures and systems for their recognition in environments within and beyond the home.

Snapshots

This is the technical setup of the second prototype in the series of three iterations for this paper exploring multi-modal human-object interactions in the home environment. 

This is the prototype with LED lamp, Kinect, arduino, iPad, and laptop depicting the depth histogram of the user. The same setup depicted is used for participants in their selected environment, but the arduino, cables, and laptop are hidden.

Resulting Figures during the exploration of various gestures.

Team

Hanley Weng, Karen Ho, advised by Dr Anne Marie Piper