tilequeue
tilequeue copied to clipboard
tilezen
Queue operations to manage the processes surrounding tile rendering.
When unzipping an archive with `unzip` (e.g. `s3://vector-tiles-prod/20180326/a8a6c/all/11/333/744.zip`), files have `0000` permissions and need to be manually `chmod`'d by `root` to become readable. The fix appears to be to add...
When we render the job called `0/0/0`, we generate tiles at the _nominal zoom_ associated with the tile size and metatile size. For example, with 8x8 metatiles and 512px tiles,...
We have rendered the world (partially successfully), yet we seem to sometimes missing tiles (from zoom 13 upwards) Besides the seed `all` config, is there another config zoom limitation that...
Our rawr-process jobs work (we see the zips being generated) but the queue never gets empty and the number of jobs in the queue remain constant, and keep processing the...
At the moment, all the parts of the database connection information are supplied in the config file separately. #335 extended the config to allow lists of hostnames, and we previously...
From a recent batch run, we have some errors on a few tiles: ## 10/896/368 A geometry collection snuck in. ``` Traceback (most recent call last): File "/usr/src/tilequeue/tilequeue/command.py", line 2170,...
This should either move to `vector-datasource` directly, or be generalized away: https://github.com/tilezen/tilequeue/blob/36fca4824730cc0eeabb54f53b0f7f15b35423a4/tilequeue/process.py#L235-L248 When we added the `tilezen.org` source for a shapefile in `vector-datasource` this `tilequeue` code had to also be...
The wof neighbourhood sync process hangs. We should: * try to prevent this from happening * get alerted if it does
We're likely to hit rate-limiting issues from upstream, or random 503 errors, if we try to do large batches of operations. These should be fairly rare, as the `file_hash` field...
The WOF metafiles are no longer distributed in this fashion: https://github.com/tilezen/tilequeue/blob/e8658a213cf1305ae8810aa6a1397673d7bd5969/config.yaml.sample#L186-L201 We'll need to switch to ZIP or SQLite bundles instead.