Monthly Archives: May 2016

“Three-Point Interaction: Combining Bi-Manual Direct Touch with Gaze” paper accepted at AVI 2016

This paper explores the use of eye gaze as a third channel supporting bimanual touch interaction. We explored whether users can perform three actions in parallel and how effective they are. Results show that for 13% of the time, users acted in complete parallelism. We discuss how three-point user interfaces could benefit from a third channel.

I will be presenting this paper at the ACM Advanced Visual Interfaces Conferences to be held in Bari, Italy this June (7-10), for which I was also chosen to serve as a Program Committee member.


↑ Jump to Top

A.L. Simeone, A. Bulling, J. Alexander, and H. Gellersen.
Three-Point Interaction: Combining Bi-Manual Direct Touch with Gaze
In Proceedings of Advanced Visual Interfaces 2016 (AVI 2016). ACM, pp. 168-175.

PDF Version of DocumentVideo

The benefits of two-point interaction for tasks that require users to simultaneously manipulate multiple entities or dimensions are widely known. Two-point interaction has become common, e.g., when zooming or pinching using two fingers on a smartphone. We propose a novel interaction technique that implements three-point interaction by augmenting two-finger direct touch with gaze as a third input channel. We evaluate two key characteristics of our technique in two multi-participant user studies. In the first, we used the technique for object selection. In the second, we evaluate it in a 3D matching task that requires simultaneous continuous input from fingers and the eyes. Our results show that in both cases participants learned to interact with three input channels without cognitive or mental overload. Participants' performance tended towards fast selection times in the first study and exhibited parallel interaction in the second. These results are promising and show that there is scope for additional input channels beyond two-point interaction.
author={Simeone, Adalberto L., Bulling, Andreas, Alexander, Jason, Gellersen, Hans},
booktitle={Advanced Visual Interfaces 2016},
series = {AVI 2016},
title={Three-Point Interaction: Combining Bi-Manual Direct Touch with Gaze},
pages = {168--175},
numpages = {8},
doi = {10.1145/2909132.2909251},