internetarchive
Lot of fuzz in background picture
Hi Merlijn,
I like this repo as it looks like the first serious open source MRC PDF solution I've found. However, I recently filed an issue with didjvu that has equal bad background fuzz. However, that was diminished by using the better DjVu-algorithm from C44 instead of DjVuMake for removing the surrounding pixels from characters:
https://github.com/jwilk/didjvu/issues/18
I guess when you try the picture overthere you'll find a similar fuzzy background with this MRC PDF-compressor. It might be interesting to study the algorithm in the open source c44 to better separate the foreground from the background.
By the way, you'll probably need a good IPS-monitor to see that fuzz in the lower 2 bits. It doesn't show on my old Medion-monitor.
I ran your image in recode_pdf:
cp outputbase2-000-raar-effect-onderste-regel-didjvu\ zonder\ tekst.tif img.tif
tesseract img.tif - hocr > img.hocr
recode_pdf --from-imagestack /tmp/img.tif --hocr-file /tmp/img.hocr -o /tmp/out.pdf
Processed 1 pages at 3.73 seconds/page
mrcview /tmp/out.pdf /tmp/mrc.pdf
See file below -- do you see the same background fuzz?
[out.pdf](https://github.com/internetarchive/archive-pdf-tools/files/7597950/out.pdf mrc.pdf )
Yes, with Acrobat Reader DC it takes some time to render the foreground, in a fraction of a second I can see lot of fuzzy edges of those letters.
If you don't have an IPS-monitor, my Android Phone is also showing it.
Outlook voor Android downloadenhttps://aka.ms/ghei36
From: Merlijn Wajer @.> Sent: Wednesday, November 24, 2021 7:17:42 PM To: internetarchive/archive-pdf-tools @.> Cc: rmast @.>; Author @.> Subject: Re: [internetarchive/archive-pdf-tools] Lot of fuzz in background picture (Issue #26)
I ran your image in recode_pdf:
cp outputbase2-000-raar-effect-onderste-regel-didjvu\ zonder\ tekst.tif img.tif tesseract img.tif - hocr > img.hocr recode_pdf --from-imagestack /tmp/img.tif --hocr-file /tmp/img.hocr -o /tmp/out.pdf Processed 1 pages at 3.73 seconds/page mrcview /tmp/out.pdf /tmp/mrc.pdf
See file below -- do you see the same background fuzz?
[out.pdf](https://github.com/internetarchive/archive-pdf-tools/files/7597950/out.pdf mrc.pdfhttps://github.com/internetarchive/archive-pdf-tools/files/7597951/mrc.pdf )
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://github.com/internetarchive/archive-pdf-tools/issues/26#issuecomment-978118496, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AAZPZ5W6H7RJGW6E4JIXKZDUNUT4NANCNFSM5IWWC63A. Triage notifications on the go with GitHub Mobile for iOShttps://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Androidhttps://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.
Right, so you're referring to the background not fully having the text layer removed. There are some tricks you can do, see for example https://github.com/internetarchive/archive-pdf-tools/issues/8 (looks like you found it) - but they also harm the quality in some other cases.
In general the latest releases (the one I shared with you) has gotten much better at making the background just background. Providing it the right DPI for example matters some too, and then the binarisation methods also matter. At archive.org we also deal with a lot of books, if you know that you're dealing only with text, there's a lot more that can be done.
In general, this project is pretty new: it's hardly a year old, and I started it because most of the tools (as you have found) don't do MRC at all, so I decided to write it myself.
BTW: the PDFs I shared about are already ~40x smaller than the tif that you uploaded, which is about as much as you can expect from MRC. If you want more compression, you can downsample the background, like so:
$ recode_pdf --from-imagestack /tmp/img.tif --hocr-file /tmp/img.hocr -o /tmp/out.pdf --bg-downsample 3 -v --dpi 600 --fg-compression-flags '-slope 45000' --mask-compression jbig2
MMX
SSE
SSE2
SSE3
SSSE3
SSE41
POPCNT
SSE42
AVX
F16C
FMA3
AVX2
Creating text only PDF
Starting page generation at 2021-11-24T19:34:25.015312
Finished page generation at 2021-11-24T19:34:25.025512
Creating text pages took 0.0102 seconds
Inserting (and compressing) images
Converting with image mode: 2
MRC time breakdown: {'image_load': 0, 'grey_conversion': 358, 'hocr_mask_gen': 101, 'est_1': 91, 'threshold': 350, 'fast_denoise': 22, 'mask_jbig2': 174, 'fg_partial_blur': 719, 'fg_jp2': 309, 'bg_partial_blur': 770, 'bg_downsample': 270, 'bg_jp2': 82, 'page_image_insertion': 0}
Saving PDF now
Processed 1 pages at 3.63 seconds/page
Compression ratio: 66.214312
which leads to a 64K PDF with the following breakdown:
$ pdfimagesmrc /tmp/out.pdf
backsize: 4.00% 2.43kB
frntsize: 40.16% 24.42kB
masksize: 39.18% 23.82kB
restsize: 16.66% 10.13kB
If you remove the text layer (restsize), it'd be a bit smaller still.
I've been looking to collect a relatively large sample of different test images. I only have a few here now: https://github.com/internetarchive/archive-pdf-tools/tree/tests/tests/files
If you'd like to contribute some, that could also help in the future when trying to further improve the background generation.
Do you have some pointers to C44 implementations (C or Python)? I'd like to try it on some of the books with images/photos that I have.
It's part of the DjVuLibre toolset on sourceforge
From: Merlijn Wajer @.> Sent: Wednesday, November 24, 2021 8:34:57 PM To: internetarchive/archive-pdf-tools @.> Cc: rmast @.>; Author @.> Subject: Re: [internetarchive/archive-pdf-tools] Lot of fuzz in background picture (Issue #26)
Do you have some pointers to C44 implementations (C or Python)? I'd like to try it on some of the books with images/photos that I have.
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://github.com/internetarchive/archive-pdf-tools/issues/26#issuecomment-978165943, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AAZPZ5UGZTKLCTP3557ZLEDUNU46DANCNFSM5IWWC63A. Triage notifications on the go with GitHub Mobile for iOShttps://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Androidhttps://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.
Didjvu calls it in combination with a mask picture so it can leave out all occluded parts from the wavelet compressed result.
Outlook voor Android downloadenhttps://aka.ms/ghei36
From: Robert Mast @.> Sent: Wednesday, November 24, 2021 8:47:39 PM To: internetarchive/archive-pdf-tools @.>; internetarchive/archive-pdf-tools @.> Cc: Author @.> Subject: Re: [internetarchive/archive-pdf-tools] Lot of fuzz in background picture (Issue #26)
It's part of the DjVuLibre toolset on sourceforge
From: Merlijn Wajer @.> Sent: Wednesday, November 24, 2021 8:34:57 PM To: internetarchive/archive-pdf-tools @.> Cc: rmast @.>; Author @.> Subject: Re: [internetarchive/archive-pdf-tools] Lot of fuzz in background picture (Issue #26)
Do you have some pointers to C44 implementations (C or Python)? I'd like to try it on some of the books with images/photos that I have.
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://github.com/internetarchive/archive-pdf-tools/issues/26#issuecomment-978165943, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AAZPZ5UGZTKLCTP3557ZLEDUNU46DANCNFSM5IWWC63A. Triage notifications on the go with GitHub Mobile for iOShttps://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Androidhttps://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.
Interesting. In the past I had also looked at specifying the region of interest (https://www.researchgate.net/publication/252087916_Selecting_the_don't_care_bits_in_JPEG2000_ROI_coding) with kakadu or openjpeg, but it didn't seem to make a difference.
Do you perhaps have a few instructions on how to use this? I'm working on these kind of improvements in my spare time and I don't have a lot of time to investigate the djvu tooling. The sourceforge website isn't too helpful and I got the same impression when I last checked this out: the project looks a bit dead and it's not clear how they want you (as a user) to use it. Thanks in advance!
It looks like c44 can create a djvu file from a mask file and an input image, and then djvuextract can extract some parts (although I am not sure how to read it yet)
e.g.
c44 /tmp/img.pnm -mask /tmp/out-mask.pbm /tmp/out.djvu
and
$ djvuextract /tmp/out.djvu BG44=/tmp/out-djvu-bg
BG44=/tmp/out-djvu-bg --> "/tmp/out-djvu-bg" (290742 bytes)
Yes. You can also use Djvutoy to convert the djvu to pdf. Unfortunately DjVuToy is freeware, but not open source. DjVuToy even translates a jb2 to jbig2 dictionary 1:1.
Outlook voor Android downloadenhttps://aka.ms/ghei36
From: Merlijn Wajer @.> Sent: Wednesday, November 24, 2021 9:23:44 PM To: internetarchive/archive-pdf-tools @.> Cc: rmast @.>; Author @.> Subject: Re: [internetarchive/archive-pdf-tools] Lot of fuzz in background picture (Issue #26)
It looks like c44 can create a djvu file from a mask file and an input image, and then djvuextract can extract some parts (although I am not sure how to read it yet)
e.g.
c44 /tmp/img.pnm -mask /tmp/out-mask.pbm /tmp/out.djvu
and
$ djvuextract /tmp/out.djvu BG44=/tmp/out-djvu-bg BG44=/tmp/out-djvu-bg --> "/tmp/out-djvu-bg" (290742 bytes)
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://github.com/internetarchive/archive-pdf-tools/issues/26#issuecomment-978195161, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AAZPZ5VIJPKZ7O6A6RJE7PDUNVCVBANCNFSM5IWWC63A. Triage notifications on the go with GitHub Mobile for iOShttps://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Androidhttps://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.
For my understanding, do you know how this deals with non-text, like images? I was able to see some output (by converting to postscript and then postscript to pdf) and it seems to perform quantization on the background, which is fine if the background uniform, but not if it contains any kind of drawings or interesting colours?
Here are some examples from (much) older versions of this software: https://archive.org/~merlijn/projects/archive-pdf-tools/index.html#mrc-examples
If you want to see the hole package of DjVu patents at work DjVuSolo 3.1 converts tiffs to a djvu that's immediately displayed. You can select info and layers via the menus.
I see two large pictures with text fuzz on the bottom of your example page, which together only add one little colored picture to the left of a further bitonal image. Leaving out fuzz and at least the lowest resolution one of the two, would runlenght encoded for the empty space probably be much smaller.
If you are interested in compressing comics then Ma Jian of DjVuToy also has a lot of knowledge on that subject. He even pointed me to another freeware tool he maintains to preprocess those pictures.
One of the steps you would want is posterizing and palettizing to reduce the colors to the visually different colors.
One of the problems with the usual jb2/jbig2 coder is that it needs backgroundspace between foreground pictures. I read djvupalette can make jb2’s with consecutive colored glyphs. Coloring of jb2-glyphs with a fgbz-segment is however not possible in PDF. I saw DjVuToy to split such colored JB2’s to multiple JBIG2’s with a shared dictionary-indirection. Those separate JBIG2’s than can have different colors and together form the original colored picture.
Alexander Truvanof has the opinion automatic compression always has flaws that need manual correction, so you’ll always need some workflow to be able to visually judge the intermediate results.
By the way, I don't think MRC would be the best approach to compress comics. The content abides to several rules such as homogenous fill color, pen thickness, splines, so I guess a vector language like PostScript would be the closest language to describe such drawings with minimal overhead.
http://citeseerx.ist.psu.edu/viewdoc/download;jsessionid=93DF060319E2A6241F40D1F261A22D0C?doi=10.1.1.489.8522&rep=rep1&type=pdf
I also see mentioning of a .CBR, Comic Book Reader compression format.
Manual correction is hard on the scale that I/we usually use this program (many million of pages every day).
You can find a comic I tested on recently here (https://archive.org/details/bruno-de-bever-a01):
- https://wizzup.org/bruno-mrc.pdf
- https://wizzup.org/bruno.pdf
The compression ratio is only ~4x because of a specific archive.org policy where we use higher quality compression for the first 10 and last 5 pages of an artifact (and this one only has 33 pages).
If I look at the textballoon https://wizzup.org/bruno.pdf p. 18 "Waar heb je het over, ik heb geen spullen" "Ben je echt alleen"
I see a lot of fuzzy color in the textballoons, where the original has more white in those textballoons, together with some jpeg-artefacts around the text. With the resolution of the color in the textballoons I would expect there to be some blocking at the edge, But not that the color of the hat of the blackbird goes 3 pixels above the black line:
Right, that happens because of an algorithm I wrote that attempts to make the images a bit more smooth to compress, but can cause the colours to bleed through a bit: https://github.com/internetarchive/archive-pdf-tools/blob/master/cython/optimiser.pyx#L65 - I've observed similar things with the PDFs produced by the foxit (luratech) pdf compressor
It might be possible to add some more algorithms, allow tweaking more parameters to be tweaked to create "profiles" for certain input types. I've tried to make it all pretty generic so that it should do a decent job for a wide range of input documents.
(Very open to improvements btw -- I've been toying with this on and off for a year and this is best I could come up with currently)
The first thing I could think of is try to do the same with DjVuSolo 3.1 to see whether there are better options for which patents will be expiring very soon. The American patent however has a strange enddate with no clear relation to the filing date. That should be 20 years max difference. One of the european patents expires in two months.
I've made a DjVu from the with standard settings of DjVuSolo3.1, which has this look in WinDjView:
The resulting djvu of this picture has about the same size as the pdfsam split page of your pdf which has this look in Acrobat DC:
However unfortunately, when I make DjVuToy convert the DjVu to PDF it becomes twice as big. Documents.zip
Your algorithm seems to preserve more of the drawn lines if you look at the eyes and the nose on the right, but both damage the tree above the character on the right. This was the original:
https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8404928/#B41-jimaging-07-00153 https://github.com/WangJieying/SDMD-resources https://github.com/WangJieying/SDMD-resources/blob/main/cartoon.md So I would propose to diverge from PDF for this purpose, or look whether some vector description language possible within PDF could be used for the vectors.
Unfortunately this SDMD requires CUDA, which I don't have. I could probably rent one at AWS or Azure.
Interesting how the DjVu code does the inverse: removing colour around the beak of the raven and the teeth of the beaver.