Survey on the teaching of 3D Interaction and Virtual reality

As part of a larger project, we are currently running a survey on the teaching of 3D Interaction and Virtual Reality. If you teach courses that are related even marginally to those topics, please consider taking the time to fill the survey.

The full details are reported on the survey’s welcome page. It should not take longer than 10-15 minutes. We will share the results with the community.

You can access the survey here. Thank you!

Share this article
  • Facebook
  • Twitter
  • Reddit
  • Email

General Chair for SUI 2017

It’s a great honour to have been chosen as the next General Chair for the ACM Symposium on Spatial User Interaction for 2017. The symposium will take place in Brighton, United Kingdom, together with ACM ISS 2017. Here is my welcome message shown at the closing event of SUI 2016.

 

Share this article
  • Facebook
  • Twitter
  • Reddit
  • Email

ACM Symposium on Spatial User Interaction 2016

I’m happy to report that I have been invited to serve on the ACM SUI 2016 program committee! The conference will be held in Tokyo, on the 15-16 October.

Share this article
  • Facebook
  • Twitter
  • Reddit
  • Email

“Three-Point Interaction: Combining Bi-Manual Direct Touch with Gaze” paper accepted at AVI 2016

This paper explores the use of eye gaze as a third channel supporting bimanual touch interaction. We explored whether users can perform three actions in parallel and how effective they are. Results show that for 13% of the time, users acted in complete parallelism. We discuss how three-point user interfaces could benefit from a third channel.

I will be presenting this paper at the ACM Advanced Visual Interfaces Conferences to be held in Bari, Italy this June (7-10), for which I was also chosen to serve as a Program Committee member.

Publications

↑ Jump to Top
PDF

A.L. Simeone, A. Bulling, J. Alexander and H. Gellersen.
Three-Point Interaction: Combining Bi-Manual Direct Touch with Gaze
In Proceedings of Advanced Visual Interfaces 2016 (AVI 2016). ACM, to appear.

PDF Version of Document

Share this article
  • Facebook
  • Twitter
  • Reddit
  • Email
The benefits of two-point interaction for tasks that require users to simultaneously manipulate multiple entities or dimensions are widely known. Two-point interaction has become common, e.g., when zooming or pinching using two fingers on a smartphone. We propose a novel interaction technique that implements three-point interaction by augmenting two-finger direct touch with gaze as a third input channel. We evaluate two key characteristics of our technique in two multi-participant user studies. In the first, we used the technique for object selection. In the second, we evaluate it in a 3D matching task that requires simultaneous continuous input from fingers and the eyes. Our results show that in both cases participants learned to interact with three input channels without cognitive or mental overload. Participants' performance tended towards fast selection times in the first study and exhibited parallel interaction in the second. These results are promising and show that there is scope for additional input channels beyond two-point interaction.
@inproceedings{Simeone2016ThreePoint,
author={Simeone, Adalberto L., Bulling, Andreas, Alexander, Jason, Gellersen, Hans},
booktitle={Advanced Visual Interfaces 2016},
series = {AVI 2016},
title={Three-Point Interaction: Combining Bi-Manual Direct Touch with Gaze},
year={2016},
month={June},
organization={ACM},
}

“Indirect Touch Interaction for Manipulation with Stereoscopic Displays” paper accepted at 3DUI 2016

My full paper on using Indirect Touch multi-touch interaction techniques for stereoscopic displays has been accepted at the IEEE Symposium on 3D User Interfaces 2016, to be held in Greenville, SC, USA.

Publications

↑ Jump to Top
PDF

A.L. Simeone.
Indirect Touch Manipulation for Interaction with Stereoscopic Displays
In Proceedings of 3D User Interfaces 2016 (3DUI 2016). IEEE, pp. 13-22.

PDF Version of DocumentPresentation SlidesVideo

Share this article
  • Facebook
  • Twitter
  • Reddit
  • Email
Research on 3D interaction has explored the application of multi-touch technologies to 3D stereoscopic displays. However, the ability to perceive 3D objects at different depths (in front or behind the screen surface) conflicts with the necessity of expressing inputs on the screen surface. Touching the screen increases the risk of causing the vergence-accommodation conflict which can lead to the loss of the stereoscopic effect or cause discomfort. In this work, we present two studies evaluating a novel approach based on the concept of indirect touch interaction via an external multi-touch device. We compare indirect touch techniques to two state-of-the-art 3D interaction techniques: DS3 and the Triangle Cursor. The first study offers a quantitative and qualitative study of direct and indirect interaction on a 4 DOF docking task. The second presents a follow-up experiment focusing on a 6 DOF docking task. Results show that indirect touch interaction techniques provide a more comfortable viewing experience than both techniques. It also shows that there are no drawbacks when switching to indirect touch, as their performances in terms of net manipulation times are comparable.
@inproceedings{Simeone2016Indirect,
author={Simeone, Adalberto L.},
booktitle={3D User Interfaces 2016},
series = {3DUI 2016},
title={Comparing Direct and Indirect Touch in a Stereoscopic Interaction Task},
pages={13--22},
year={2016},
month={March},
organization={IEEE},
}

Substitutional Reality: bringing Virtual Reality home

The ACM XRDS magazine for students published in its fall issue our article on recent developments on Substitutional Reality. The rest of the issue also contains several interesting articles and perspectives on Virtual Reality!

XRDS SR

Publications

↑ Jump to Top
PDF

A.L. Simeone.
Substitutional Reality: Bringing virtual reality home
In Proceedings of (XRDS 22 (November 2015)). ACM, pp. 24-9.


Share this article
  • Facebook
  • Twitter
  • Reddit
  • Email
Now that virtual reality headsets are finally reaching the wider consumer market, how can we merge the physical and virtual worlds to create a unified multi-sensory experience?
@article{simeone2015VRHome,
title={Substitutional Reality: Bringing virtual reality home},
author={Simeone, Adalberto L. and Velloso, Eduardo},
journal={XRDS: Crossroads, The ACM Magazine for Students},
volume={22},
number={1},
pages={24--29},
year={2015},
publisher={ACM}
}

CHI 2015 Talk on Substitutional Reality now online

I have uploaded the talk I gave on April 23, 2015 in Seoul at the CHI 2015 conference on our research work on Substitutional Reality. It is now online on youtube!

Share this article
  • Facebook
  • Twitter
  • Reddit
  • Email

Substitutional Reality: Towards a Research Agenda (WEVR 2015)

The workshop paper on Substitutional Reality published at the IEEE 1st Workshop on Everyday Virtual Reality is now available on the IEEE Xplore library and here (preprint version).

Publications

↑ Jump to Top
PDF

A.L. Simeone.
Substitutional reality: Towards a research agenda
In Proceedings of 1st Workshop on Everyday Virtual Reality (WEVR 2015). IEEE, pp. 19-22.

PDF Version of Document

Share this article
  • Facebook
  • Twitter
  • Reddit
  • Email
In our previous work on Substitutional Reality, we presented an exploration of a class of Virtual Environments where every physical object surrounding the user is associated with appropriate virtual counterparts. Differently from "passive haptics", Substitutional Reality assumes the existence of a discrepancy in the association. This previous work explored how far this mismatch can be pushed and its impact on the believability of the experience. In this paper we discuss three main research directions for Substitutional Reality. Firstly, the design space is largely unexplored as the initial investigation focused on the mismatch between real and virtual objects. Secondly, the development of systems enabling a dynamic substitution process represents a key challenge. Thirdly, we discuss the meta-design process of these experiences..
@inproceedings{Simeone2015SubRealAgenda,
title={Substitutional reality: Towards a research agenda},
author={Simeone, Adalberto L},
booktitle={1st Workshop on Everyday Virtual Reality (WEVR)},
pages={19--22},
year={2015},
organization={IEEE}
}

Substitutional Reality video now online

The video accompanying our research paper on Substitutional Reality is now online on youtube!

Share this article
  • Facebook
  • Twitter
  • Reddit
  • Email

“Select & Apply: Understanding How Users Act Upon Objects Across Devices” accepted at Personal and Ubiquitous Computing

Our paper was just accepted at the Personal and Ubiquitous Computing journal. As our interactions increasingly cut across diverse devices, we often encounter situations where we find information on one device but wish to use it on another device for instance a phone number spotted on a public display but wanted on a mobile. We conceptualise this problem as Select & Apply and contribute two user studies where we presented participants with eight different scenarios involving different device combinations, applications and data types. In the first, we used a think-aloud methodology to gain insights on how users currently accomplish such tasks and how they ideally would like to accomplish them. In the second, we conducted a focus group study to investigate which factors influence their actions. Results indicate shortcomings in present support for Select & Apply and contribute a better understanding of which factors affect cross-device interaction.

Publications

↑ Jump to Top
PDF

A.L. Simeone, M.K. Chong, C. Sas and H. Gellersen.
Select & Apply: Understanding How Users Act Upon Objects Across Devices
Personal and Ubiquitous Computing, vol. 19(5), Feb. 2015. Springer, 1-16.

PDF Version of Document

Share this article
  • Facebook
  • Twitter
  • Reddit
  • Email
As our interactions increasingly cut across diverse devices, we often encounter situations where we find information on one device but wish to use it on another device for instance a phone number spotted on a public display but wanted on a mobile. We conceptualise this problem as Select Apply and contribute two user studies where we presented participants with eight different scenarios involving different device combinations, applications and data types. In the first, we used a think-aloud methodology to gain insights on how users currently accomplish such tasks and how they ideally would like to accomplish them. In the second, we conducted a focus group study to investigate which factors influence their actions. Results indicate shortcomings in present support for Select Apply and contribute a better understanding of which factors affect cross-device interaction.
@article{Simeone2015SelectApply
year={2015},
issn={1617-4909},
journal={Personal and Ubiquitous Computing},
doi={10.1007/s00779-015-0836-1},
title={Select & Apply: understanding how users act upon objects across devices},
url={http://dx.doi.org/10.1007/s00779-015-0836-1},
publisher={Springer London},
author={Simeone, Adalberto L. and Chong, Ming Ki and Sas, Corina and Gellersen, Hans},
pages={1-16},
language={English}
}