olmocr bench evaluation

[jhxiang]

Can I use the sample data provided in the bench to evaluate my own pipeline? However, I found that the PDF annotation in dataset.jsonl is too simple. What is the reason?

[jakep-allenai]

Yes, you can try out the benchmark tools, but the full benchmark dataset is not available yet. We are still preparing it, hope to be done end of the month.

[aman-17]

Hey @jhxiang benchmark is available and you can try it out.