Pen-centric Computing

[AdamSobieski]

I would like to propose that pen-centric computing be considered as an important XR scenario.

Users could hold pencils, pens, dry-erase markers, or similarly shaped stylus devices, and computer vision algorithms could track the positions and orientations of these objects in space and time.

If a stylus device should have internal sensors, computer vision algorithms could corroborate, enhance, and potentially calibrate the measurements from the devices.

Whether using plain pencils, pens, or dry-erase markers, or advanced digital styluses, users could write on paper, dry-erase boards, or other surfaces while simultaneously authoring digital documents.

In addition to design-related applications, exciting scenarios include science, technology, engineering and mathematics education and collaboration.

See also:

• https://immersive-web.github.io/webxr-hand-input/
• http://pen.cs.brown.edu/