Crash on larger (~2 GB) pbf's on Windows

[matsamentet]

System: Windows 11 128 GB RAM tilemaker built on the same machine according to instructions in https://github.com/systemed/tilemaker/issues/687#issuecomment-1966066055

I have been testing tilemaker on increasingly larger GeoFabrik extracts. Above a certain file size, the application crashes immediately after the "Reading .pbf" message. I found the limit between us-midwest (2 129 162 240 bytes) works britain-and-ireland (2 185 531 392 bytes) crashes

I'm not really a developer and certainly not a c++ dev, but this smells to me like it's related to the limit of a signed 32 bit integer somewhere.

[SomeoneElseOSM]

If it helps, on a Linux system I've not seen that.

At 27/10/2024 00:14 I ran https://github.com/SomeoneElseOSM/SomeoneElse-vector-extract/blob/main/update_vector.sh using "Britain and Ireland", which at the time was around 2180837777 (i.e. more than 2147483648) without any immediate crash. After that date I ran into OOM issues but that's entirely down to the test machine (a Hetzner CAX21) that I was using.

The tilemaker version was built from source on 26th May so would be whatever was current at that time.

[titemov]

Same issue. Every file bigger than 2GB just crashes while incrementing "Blocks". For example last log messages for russia-latest.osm.pbf (using --verbose):

Way 879887163 has not been closed
Way 879887164 has not been closed
Block 4775/6313 Way 879913359 has not been closed
Way 879913360 has not been closed
Way 879921080 has not been closed

And after that silent crash.

tilemaker is being run inside Docker. Commands such as --shard-stores, --fast, --compact gave no impact.