Off-Screen Desktop


Erik Paluka, Christopher Collins


We present Off-Screen Desktop, spatial navigation techniques that make use of the space around the display to extend direct manipulation beyond the desktop screen. To enable off-screen direct manipulation, these techniques visually transform the information space without affecting its interaction space. This allows a person to interact with the information space as if it physically extended beyond the boundaries of the display. Off-Screen Desktop is characterized by its implicit transience where the applied visual transformations are automatically reverted when the hand leaves the associated spatial interaction space. We illustrate Off-Screen Desktop with the design of three different techniques, which include Dynamic Distortion, Spatial Panning, and Dynamic Peephole Inset, as well as their evaluation in a comparative study with standard mouse panning. We also demonstrate their applicability with a number of use cases. Study results show that Spatial Panning was overall significantly faster than the other Off-Screen Desktop techniques when employed in two different navigation tasks.


  • E. Paluka, “Spatial Peripheral Interaction Techniques for Viewing and Manipulating Off-Screen Digital Content,” Master’s Thesis, 2015.
    [Bibtex] [PDF]
      author =    {Erik Paluka},
      title =    {Spatial Peripheral Interaction Techniques for Viewing and Manipulating Off-Screen Digital Content},
      school =    {University of Ontario Institute of Technology},
      year =    2015



EduApps – Supporting Non-Native English Speakers to Overcome Language Transfer Effects

Metatation: Annotation as Implicit Interaction to Bridge Close and Distant Reading

DataTours: A Data Narratives Framework

Perceptual Biases in Font Size as a Data Encoding

Progressive Learning of Topic Modeling Parameters: A Visual Analytics Framework

Abbreviating Text Labels on Demand

NEREx: Named-Entity Relationship Exploration in Multi-Party Conversations

ConToVi: Multi-Party Conversation Exploration using Topic-Space Views

PhysioEx: Visual Analysis of Physiological Event Streams

Using Visual Analytics of Heart Rate Variation to Aid in Diagnostics

Off-Screen Desktop


Reading Comprehension on Mobile Devices

#FluxFlow: Visual Analysis of Anomalous Information Spreading on Social Media

Optimizing Hierarchical Visualizations with the Minimum Description Length Principle


SentimentState: Exploring Sentiment Analysis on Twitter

Facilitating Discourse Analysis with Interactive Visualization




Simple Multi-Touch Toolkit

Exploring Text Entities with Descriptive Non-photorealistic Rendering

Investigating the Semantic Patterns of Passwords

Bubble Sets: Revealing Set Relations with Isocontours over Existing Visualizations

Parallel Tag Clouds to Explore Faceted Text Corpora

VisLink: Revealing Relationships Amongst Visualizations

DocuBurst: Visualizing Document Content using Language Structure

Tabletop Text Entry Techniques

Lattice Uncertainty Visualization: Understanding Machine Translation and Speech Recognition

WordNet Visualization

// Where the sidebar information is stored
| © Copyright vialab | Dr. Christopher Collins, Canada Research Chair in Linguistic Information Visualization |