Abstract

Current workflow on co-editing and simultaneous presentation of 3-D shapes is confined to on-screen manipulation, which causes loss of perceived information when presenting perceptual concepts or complex shapes between members. Thus, we create TeleSHift, a 3-D tangible user interface (TUI) with a telexisting communication framework for group-based collaboration and demonstration. In this work, we present a larger-scaled proof-of-concept prototype providing hands-on operation for shape-based interactions including multi-sided collaboration and one-to-many presentation. In contrast to previous works, we further extend the use of TUIs to support cooperative tasks with telexistence while enabling the linkage of manipulable bits to provide a better user experience and interactivity.

Problem & Background Research

Tangible User Interfaces (TUIs) enable humans to perceive spatial information more intuitively. Ever since its introduction, its applications have extended from simple static model-presenting tasks to providing touch-based feedback with a degree of interactivity. Even so, we consider that its applications have not been thoroughly explored and see the potential of TUIs in supporting the collaboration of physical prototyping and dimensional presentation. 

When it comes to presenting 3-D shapes and structures with 2-D interfaces, especially during simultaneous editing, perceptual loss of accessed information would inevitably occur. The concept of telexistence is to make two separated objects in different physical spaces to sense co-presence via interaction. On top of that, we proposed a 3-D TUI to achieve more realistic feedback and thorough perception, while enhancing interaction experience on both dimensional information knowing and object-initiated interpersonal exchanges.

This work contributes by exploring the use of TUIs in physically manipulating and presenting 3-D shapes while also creating a functional, larger-scaled proof-of-concept prototype with telexisting abilities to provide parallel display and simultaneous altering of shape-based information for multi-sided physical collaboration.

Proposing Scenarios

Into Prototype Collaboration

When it comes to a group of designers physically in different spaces working together on a prototyping task creating an ergonomic mouse, a common workflow would be to rely on 2-D interfaces of computer-aided design tools for cooperation. However, a loss of perceived information, especially when collaborating simultaneously, would often occur when presenting perceptual concepts or complex shapes between the collaborating members. With TeleSHift, the designers can now collaborate on the mouse’s prototype at the same time: Not only could they present the deformation of the created shape, parallel knowing and simultaneous shape-shifting can be achieved when one manually modifies his or her TeleSHift by presenting the same deformation status on the others’ at the same time, and vice versa. 

Into Dimensional Teaching

Another applicable scenario would be when a teacher wants to present the process on creating a basic structure of a chair to several students and asks them to create their own unique design with some high-cost or rare material. The teacher can manually demonstrate the shaping process with TeleSHift, while students can watch and learn about the structural change with their own TeleSHifts at the same time. Moreover, students’ manipulation of their devices would not affect both the other students and the teacher, which allows students to come up with their own creations. On the other hand, students can store the deformation status during their design at any time. When an undo process is required, they can return to the specific shape and redesign the chair. 

Conference & Proceedings

Best Demo Award @ ACM UbiComp/ISWC '22

Andrew Chen, Tzu-Ling Yang, Shu-Yan Cheng, Po-Sheng Cheng, Tzu-Han Lin, and Kaiyuan Lin. 2022. TeleSHift: Telexisting TUI for Physical Collaboration & Interaction. In Proceedings of the 2022 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp/ISWC ’22 Adjunct), September 11–15, 2022, Cambridge, United Kingdom. ACM, New York, NY, USA, 4 pages. [ACM DL]