Skip to content
wbueschel edited this page Feb 19, 2013 · 2 revisions

Navigation

  • Visualizing table of content/document structure/index as overlay on the lens
  • Indicator of current position and position of reference target (e.g., section, figure…)
  • Preview of internal and external references and figures
  • Providing keywords for overview

Sketch: visualization of reference targets

Searching

  • Query by example (by selecting visible word) and enter handwritten queries by pen input on the lens
  • Highlighting of search results under lens
  • Visualization for off-screen search results on current page (by using visual cues along the border of the lens)
  • Visualization of search results within the rest of the document (by occurrence indicator along the two edges of the lens)

Sketch: showing search result occurences

Content transformation

  • Translate whole content under the lens to another language (e.g., next to original text or split screen while moving lens along the page)
  • Using lens as magnifying glass (showing indicator around original text for magnified paragraph)
  • Customizing font size/type

Sketch: split screen translation

Support for interactive content

  • Showing video instead of static image
  • Different representations of diagrams
  • Selecting data points
  • (Semantic) Zooming
  • Mask out parts of the shown data
  • Changing parameters interactively…
  • Showing time dependent visualizations/animations (e.g., on maps or visualizing chemical/biological reactions)

Providing external information

  • Showing definitions for expressions
  • Translate specific expressions or words
  • Providing supplementary material (e.g., by following hypertext links)

Sketch: showing supplementary information

Annotation

  • Adding handwritten notes and comments by pen input
  • Categorizing personal notes
  • Searching and browsing in notes
  • Handwriting recognition, transformation into typed text
  • Underlining/Highlighting
  • Bookmarks
    • Setting bookmarks via touch on the lens
  • Finding bookmarks by off-screen visualization or indicators along the border of lens

Extracting paragraphs from text with reference to original paragraph

  • Saving extracts for later use
  • Comparing with paragraphs of the same document as well as with other documents
  • Sharing content (e.g., via E-Mail, Twitter…)

Ideas for Interaction

  • Visual tracking of current reading focus with the upper edge of the device
  • Moving lens along the page (e.g., for simultaneous translation, magnification…)
  • Multitouch/pen input on lens
  • Pen for highlighting, underlining, precise selection of words, handwritten annotations
  • Pinch gesture for expanding and collapsing notes
  • Flipping lens
  • Switching language in translation mode
  • Showing indicators on one side and content of notes, external information… on the other side
  • Tilting lens
  • Problematic because document itself might be tilted
  • Tilting lens left and right for navigating through extracted paragraphs
  • Lifting lens from the document rearranges content (e.g., notes and comments
  • Stacking
  • Stacking of two people’s devices for exchange of notes, annotations and highlights
  • Show both collections simultaneously and allow transfer from one layer to the other

Possible problems to consider

  • Form factor of lens (size, weight, form)
  • Different reading positions of the user, device might need to be fixed with hand, occupies NDH
  • Angle of device in relation to the tilted document
  • Bending of pages due to type of book binding might limit the contact area of the lens