Skip to main navigation Skip to search Skip to main content

Portalware: Exploring Free-Hand AR Drawing with a Dual-Display Smartphone-Wearable Paradigm

  • Jing Qian
  • , Tongyu Zhou
  • , Meredith Young-Ng
  • , Jiaju Ma
  • , Angel Cheung
  • , Xiangyu Li
  • , Ian Gonsher
  • , Jeff Huang
  • Brown University

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Free-hand interaction enables users to directly create artistic augmented reality content using a smartphone, but lacks natural spatial depth information due to the small 2D display's limited visual feedback. Through an autobiographical design process, three authors explored free-hand drawing over a total of 14 weeks. During this process, they expanded the design space from a single-display smartphone format to a dual-display smartphone-wearable format (Portalware). This new configuration extends the virtual content from a smartphone to a wearable display and enables multi-display free-hand interactions. The authors documented experiences where 1) the display extends the smartphone's canvas perceptually, allowing the authors to work beyond the smartphone screen view; 2) the additional perspective mitigates the difficulties of depth perception and improves the usability of direct free-hand manipulation; 3) the wearable use cases depend on the nature of the drawing, such as: replicating physical objects, "in-situ"mixed reality pieces, and multi-planar drawings.

Original languageEnglish
Title of host publicationDIS 2021 - Proceedings of the 2021 ACM Designing Interactive Systems Conference
Subtitle of host publicationNowhere and Everywhere
PublisherAssociation for Computing Machinery, Inc
Pages205-219
Number of pages15
ISBN (Electronic)9781450384766
DOIs
StatePublished - 28 Jun 2021
Externally publishedYes
Event2021 ACM Designing Interactive Systems Conference: Nowhere and Everywhere, DIS 2021 - Virtual, Online, United States
Duration: 28 Jun 20212 Jul 2021

Publication series

NameDIS 2021 - Proceedings of the 2021 ACM Designing Interactive Systems Conference: Nowhere and Everywhere

Conference

Conference2021 ACM Designing Interactive Systems Conference: Nowhere and Everywhere, DIS 2021
Country/TerritoryUnited States
CityVirtual, Online
Period28/06/212/07/21

Keywords

  • augmented reality
  • autobiographical design
  • free-hand drawing
  • wearable

Fingerprint

Dive into the research topics of 'Portalware: Exploring Free-Hand AR Drawing with a Dual-Display Smartphone-Wearable Paradigm'. Together they form a unique fingerprint.

Cite this