Overpass-API icon indicating copy to clipboard operation
Overpass-API copied to clipboard

Setting up an offline clonable Overpass API

Open galewis2 opened this issue 8 months ago • 1 comments

Hi, I'm trying to setup an offline clonable Overpass API for HA/scailing. I have a successfully installed and loaded one, however I am having problems making it clonable for reasons such as many of the *frequent* databases are empty:

-rw-r--r-- 1 overpass overpass 0 May  1 17:04 /db/db/relation_frequent_tags.bin.idx
-rw-r--r-- 1 overpass overpass 0 May  1 17:04 /db/db/relation_frequent_tags_attic.bin
-rw-r--r-- 1 overpass overpass 0 May  1 17:04 /db/db/relation_frequent_tags_attic.bin.idx
-rw-r--r-- 1 overpass overpass 0 May  1 17:04 /db/db/relation_frequent_tags.bin
-rw-r--r-- 1 overpass overpass 0 May  1 17:04 /db/db/way_frequent_tags.bin.idx
-rw-r--r-- 1 overpass overpass 0 May  1 17:04 /db/db/way_frequent_tags_attic.bin.idx
-rw-r--r-- 1 overpass overpass 0 May  1 17:04 /db/db/way_frequent_tags_attic.bin
-rw-r--r-- 1 overpass overpass 0 May  1 17:04 /db/db/way_frequent_tags.bin
-rw-r--r-- 1 overpass overpass 0 May  1 17:04 /db/db/node_frequent_tags.bin.idx
-rw-r--r-- 1 overpass overpass 0 May  1 17:04 /db/db/node_frequent_tags_attic.bin.idx
-rw-r--r-- 1 overpass overpass 0 May  1 17:04 /db/db/node_frequent_tags_attic.bin
-rw-r--r-- 1 overpass overpass 0 May  1 17:04 /db/db/node_frequent_tags.bin

Ultimately then, cloning fails with https://github.com/drolbr/Overpass-API/blob/a0db4f392f744d5e1304331edbf542ef6d6ce2fa/src/bin/download_clone.sh#L90 as the file never has a size and eventually would just timeout.

I notice these files have a size as per https://dev.overpass-api.de/clone/2025-04-30/

I've tried differing versions of Overpass API (with attic, with updates and without), and even fallen back to someone else's docker image in case it was an issue with mine.

Is there documentation on how to enable cloning for an instance exactly as available at http://dev.overpass-api.de/api_drolbr/ ?

galewis2 avatar May 01 '25 17:05 galewis2

On second read, all of these files are size 0

-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 relation_attic_indexes.bin.idx
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 relation_frequent_tags_attic.bin.idx
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 relation_tags_global_attic.bin.idx
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 relation_tags_local_attic.bin.idx
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 relations_attic.bin.idx
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 relations_attic_undeleted.bin.idx
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 relations_meta_attic.bin.idx
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 relation_frequent_tags.bin.idx
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 relation_frequent_tags_attic.bin
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 relation_tags_global_attic.bin
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 relation_tags_local_attic.bin
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 relations_meta_attic.bin
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 relation_attic_indexes.bin
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 relations_attic.bin
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 relations_attic_undeleted.bin
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 relation_frequent_tags.bin
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 relations_attic.map
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 way_attic_indexes.bin.idx
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 way_frequent_tags.bin.idx
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 way_frequent_tags_attic.bin.idx
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 way_tags_global_attic.bin.idx
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 way_tags_local_attic.bin.idx
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 ways_attic.bin.idx
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 ways_attic_undeleted.bin.idx
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 ways_meta_attic.bin.idx
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 way_frequent_tags_attic.bin
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 way_tags_global_attic.bin
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 way_tags_local_attic.bin
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 ways_meta_attic.bin
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 way_attic_indexes.bin
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 ways_attic.bin
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 ways_attic_undeleted.bin
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 ways_attic.map
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 way_frequent_tags.bin
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 node_attic_indexes.bin.idx
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 node_frequent_tags.bin.idx
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 node_frequent_tags_attic.bin.idx
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 node_tags_global_attic.bin.idx
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 node_tags_local_attic.bin.idx
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 nodes_attic.bin.idx
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 nodes_attic_undeleted.bin.idx
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 nodes_meta_attic.bin.idx
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 node_frequent_tags_attic.bin
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 node_tags_global_attic.bin
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 node_tags_local_attic.bin
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 nodes_meta_attic.bin
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 node_attic_indexes.bin
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 nodes_attic.bin
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 nodes_attic_undeleted.bin
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 nodes_attic.map
-rw-r--r-- 1 ubuntu ubuntu    0 May  1 22:53 node_frequent_tags.bin

Something weird is going on with my attic import. I'm using latest 0.7.62.5

galewis2 avatar May 01 '25 23:05 galewis2