360-degree video contains a full field of environmental content. However, browsing these videos, either on screens or through head-mounted displays (HMDs), users consume only a subset of the full field of view per a natural viewing experience. This causes a search problem when a region-of-interest (ROI) in a video is outside of the current field of view (FOV) on the screen, or users may search for non-existing ROIs.

We propose Outside-In, a visualization technique which re-introduces off-screen regions-of-interest (ROIs) into the main screen as spatial picture-in-picture (PIP) previews. The geometry of the preview windows further encodes a ROI’s relative location vis-à-vis the main screen view, allowing for effective navigation.

I participated in the discussion of main idea and implemented several interactive visualization of 360 videos. I also implemented the a live telepresence application.

Authors Yung-Ta Lin (National Taiwan University)
Yi-Chi Liao (National Taiwan University)
Shan-Yuan Teng (National Taiwan University)
Yi-Ju Chung (National Taiwan University)
Liwei Chan (National Chiao Tung University)
Bing-Yu Chen (National Taiwan University)
Publication Yung-Ta Lin, Yi-Chi Liao, Shan-Yuan Teng, Yi-Ju Chung, Liwei Chan, Bing-Yu Chen. 2017. Visualizing Out-of-Sight Region-of-Interests in a 360 Video Using Spatial Picture-in-Picture Previews. In Proceedings of the 30th Annual Symposium on User Interface Software and Technology (UIST ‘17). ACM, New York, NY, USA, 255-265. https://doi.org/10.1145/3126594.3126656
Paper PDF (4.1MB)