Async blob reader

Open brad-richardson opened this issue 1 year ago • 4 comments

As described in #47, adds support for async streaming of OSM PBFs. Using object_store as the input interface for flexibility - it supports most cloud providers, HTTP, and local files.

Example usage in docs and here: https://github.com/brad-richardson/osm-pbf-parquet/pull/15/files#diff-b1a35a68f14e696205874893c07fd24fdb88882b47c23cc0e0c80a30c7d53759R116

Sep 03 '24 14:09 brad-richardson

Thanks for this PR! Could you add a simple test to https://github.com/b-r-u/osmpbf/blob/main/tests/read.rs ? Just like read_blobs() but using the AsyncBlobReader.

Sep 04 '24 22:09 b-r-u

@b-r-u I've updated with the requested test and fixed the issues from the first test run. Could you rerun and give me another review? Thanks!

Sep 27 '24 15:09 brad-richardson

@b-r-u wanted to follow-up, when you get some time could you kick off the tests again and review?

Dec 06 '24 15:12 brad-richardson

Hello! Do you know when it will be released?

Jul 07 '25 11:07 slavik-pastushenko