pdf-issues icon indicating copy to clipboard operation
pdf-issues copied to clipboard

Support storing time information with `Ink` annotations

Open crlf0710 opened this issue 2 years ago • 5 comments

Some applications might want to recover information from the Ink annotations. Currently the information stored within a ink annotation dictionary (Table 185) only includes coordinates data, without any temporal data. Time delta between coordinates might be used to infer the "pen" moving speed, and improve the accuracy of the information recovery. Maybe add an optional dictionary entry that supplies such information?

crlf0710 avatar Dec 20 '23 06:12 crlf0710

There are already two existing mechanisms defined:

  • Metadata (14.3.2) for XMP-based metadata
  • Associated Files (14.13.9) for any arbitrary embedded stream of data

petervwyatt avatar Dec 20 '23 07:12 petervwyatt

So Associated Files could easily be used to store pen pressure, movement, angle, etc. in a 3rd party format.

petervwyatt avatar Dec 20 '23 07:12 petervwyatt

Yes, I totally understand that Associated Files can be used to supply "supplement" information. However in this case, it seems temporal information is one of the centric defining property, and it is distinguishing property between handwriting and casual shapes. So i think the "time" information itself is more important than the "pen pressure, angle, etc" that should be classified as supplement information (supplied by maybe InkML when absolutely needed). In fact, when the Path entry is missing and needed to be rebuild from InkList with heuristics, if the sampling rate is not uniform, different curves might get generated.

There's indeed reasons about why sometimes "time" should NOT be included (e.g. for protecting user privacy), but i think there's still value in providing such an optional entry.

crlf0710 avatar Dec 20 '23 08:12 crlf0710

Embedded files allow separate encryption (EFF, AuthEvent EFOpen, etc) so user privacy can be respected. You could also use marked content sequences on the vectors used to make up the path.

petervwyatt avatar Dec 20 '23 10:12 petervwyatt

It is worth noting that there was a proposal (2017/2018?) to TC 171/WG 8 to extend Ink annotations with time, pressure, etc. Unfortunately, there was not enough interest in the committee to move it forward. If you (@crlf0710 ) were interested in bring that (or something similar) back, I am sure that ISO committee - or the PDF Association - would welcome your participation in our working groups.

lrosenthol avatar Feb 06 '24 13:02 lrosenthol