mod_tile icon indicating copy to clipboard operation
mod_tile copied to clipboard

render_list errors

Open pnorman opened this issue 12 years ago • 6 comments

Running cat foo | render_list -s /var/run/renderd/renderd.sock -n 8 -m default -f I get errors

Starting 8 rendering threads

Meta tiles rendered: Rendered 10 tiles in 0.00 seconds (11074.20 tiles/s)
Total tiles rendered: Rendered 640 tiles in 0.00 seconds (708748.62 tiles/s)
Total tiles handled from input: Rendered 10 tiles in 0.00 seconds (11074.20 tiles/s)
rendering failed, pausing

Meta tiles rendered: Rendered 20 tiles in 0.00 seconds (14836.79 tiles/s)
Total tiles rendered: Rendered 1280 tiles in 0.00 seconds (949554.88 tiles/s)
Total tiles handled from input: Rendered 20 tiles in 0.00 seconds (14836.79 tiles/s)

Meta tiles rendered: Rendered 30 tiles in 0.00 seconds (20876.83 tiles/s)
Total tiles rendered: Rendered 1920 tiles in 0.00 seconds (1336116.88 tiles/s)
Total tiles handled from input: Rendered 30 tiles in 0.00 seconds (20876.83 tiles/s)

Meta tiles rendered: Rendered 40 tiles in 0.00 seconds (26472.54 tiles/s)
Total tiles rendered: Rendered 2560 tiles in 0.00 seconds (1694242.25 tiles/s)
Total tiles handled from input: Rendered 40 tiles in 0.00 seconds (26472.54 tiles/s)
rendering failed, pausing
rendering failed, pausing
rendering failed, pausing
rendering failed, pausing
rendering failed, pausing
rendering failed, pausing
rendering failed, pausing

I ran renderd in foreground mode and got this

renderd[1845]: DEBUG: Got incoming connection, fd 8, number 1
renderd[1845]: DEBUG: Got incoming connection, fd 10, number 2
renderd[1845]: DEBUG: Got incoming connection, fd 11, number 3
renderd[1845]: DEBUG: Got incoming connection, fd 12, number 4
renderd[1845]: DEBUG: Got incoming connection, fd 13, number 5
renderd[1845]: DEBUG: Got incoming connection, fd 14, number 6
renderd[1845]: DEBUG: Got incoming request with protocol version 2
renderd[1845]: Recv Error on fd 10 (Success). Read 65 bytes
renderd[1845]: DEBUG: Got incoming connection, fd 15, number 7
renderd[1845]: DEBUG: Got incoming request with protocol version 0
renderd[1845]: DEBUG: Got command Ignore fd(10) xml(), z(0), x(0), y(0)
renderd[1845]: WARNING: Ignoring unknown command Ignore fd(10) xml(), z(0), x(0), y(0)
renderd[1845]: DEBUG: Sending NotDone response(4)
renderd[1845]: DEBUG: Got incoming request with protocol version 2
renderd[1845]: Recv Error on fd 11 (Success). Read 65 bytes
renderd[1845]: DEBUG: Got incoming connection, fd 16, number 8
renderd[1845]: DEBUG: Got incoming request with protocol version 2
renderd[1845]: Recv Error on fd 8 (Success). Read 65 bytes
renderd[1845]: DEBUG: Got incoming request with protocol version 0
renderd[1845]: DEBUG: Got command Ignore fd(8) xml(), z(0), x(0), y(0)
renderd[1845]: WARNING: Ignoring unknown command Ignore fd(8) xml(), z(0), x(0), y(0)
renderd[1845]: DEBUG: Sending NotDone response(4)
renderd[1845]: DEBUG: Got incoming request with protocol version 0

I did a git bisect and this is the commit where it was introduced

pnorman@osm2pgsqlbench:~/osm/mod_tile$ git bisect bad
fdc317a8f36f001d3eb2a864eb7cff55f11fdeb7 is the first bad commit
commit fdc317a8f36f001d3eb2a864eb7cff55f11fdeb7
Author: Kai Krueger <[email protected]>
Date:   Sun Oct 13 23:22:08 2013 -0600

    Update mod_tile to renderd protocol to version 3.

    Include an "options" string and a "mimetype" string.

:040000 040000 a0551beb9f9874fc84e2ae21078f98bf19130265 3e75c961b2ebcfceb9f8a9307ec964d83b46ad6a M      includes
:040000 040000 a1934c59e0d8e1885e4a16b8e318a8a6cb35cedc 67035c4dbbab00909fccbaa8ccd921988f20c60d M      src

pnorman avatar Nov 15 '13 01:11 pnorman

Similar errors here. Don't exist prior to the commit that pnormann quotes.

simonpoole avatar Dec 20 '13 20:12 simonpoole

Can you see if this has been fixed in the most recent commit?

apmon avatar Dec 24 '13 00:12 apmon

Not fixed for me. render_list output:

debug: init_storage_backend: initialising file storage backend at: /raid/tiles
Rendering client
Starting 16 rendering threads
Rendering all tiles from zoom 6 to zoom 6
Rendering all tiles for zoom 6 from (0, 0) to (63, 63)
rendering failed with command 4, pausing.
Waiting for rendering threads to finish

*****************************************************
*****************************************************
Total for all tiles rendered
Meta tiles rendered: Rendered 64 tiles in 52.16 seconds (1.23 tiles/s)
Total tiles rendered: Rendered 4096 tiles in 52.16 seconds (78.53 tiles/s)
Total tiles handled: Rendered 64 tiles in 52.16 seconds (1.23 tiles/s)
*****************************************************
Zoom 06: min:  0.4    avg:  4.5     max: 45.5     over a total of    285.2s in 63 requests
*****************************************************
*****************************************************

daemon.log snippet:

renderd[21929]: DEBUG: Got incoming request with protocol version 2
renderd[21929]: DEBUG: Got command RenderBulk fd(22) xml(rumap_m), z(6), x(8), y(8), mime(image/png), options()
renderd[21929]: DEBUG: Got incoming request with protocol version 2
renderd[21929]: DEBUG: Got command RenderBulk fd(23) xml(rumap_m), z(6), x(8), y(24), mime(image/png), options()
renderd[21929]: DEBUG: Got incoming request with protocol version 2
renderd[21929]: DEBUG: Got command RenderBulk fd(24) xml(rumap_m), z(6), x(8), y(16), mime(image/png), options()
renderd[21929]: DEBUG: START TILE rumap_m 6 8-15 24-31, age 0.44 days
renderd[21929]: Rendering projected coordinates 6 8 24 -> -15028131.257100|0.000000 -10018754.171400|5009377.085700 to a 8 x 8 tile
renderd[21929]: DEBUG: START TILE rumap_m 6 8-15 16-23, age 0.44 days
renderd[21929]: Rendering projected coordinates 6 8 16 -> -15028131.257100|5009377.085700 -10018754.171400|10018754.171400 to a 8 x 8 tile
renderd[21929]: DEBUG: START TILE rumap_m 6 8-15 8-15, age 0.44 days
renderd[21929]: Rendering projected coordinates 6 8 8 -> -15028131.257100|10018754.171400 -10018754.171400|15028131.257100 to a 8 x 8 tile
renderd[21929]: DEBUG: Got incoming request with protocol version 2
renderd[21929]: DEBUG: Got command RenderBulk fd(25) xml(rumap_m), z(6), x(8), y(40), mime(image/png), options()
renderd[21929]: DEBUG: Got incoming request with protocol version 2
renderd[21929]: DEBUG: Got command RenderBulk fd(28) xml(rumap_m), z(6), x(8), y(32), mime(image/png), options()
renderd[21929]: DEBUG: START TILE rumap_m 6 8-15 40-47, age 0.44 days
renderd[21929]: Rendering projected coordinates 6 8 40 -> -15028131.257100|-10018754.171400 -10018754.171400|-5009377.085700 to a 8 x 8 tile
renderd[21929]: DEBUG: Got incoming request with protocol version 2
renderd[21929]: DEBUG: START TILE rumap_m 6 8-15 32-39, age 0.44 days
renderd[21929]: DEBUG: Got command RenderBulk fd(26) xml(rumap_m), z(6), x(8), y(56), mime(image/png), options()
renderd[21929]: Rendering projected coordinates 6 8 32 -> -15028131.257100|-5009377.085700 -10018754.171400|0.000000 to a 8 x 8 tile
renderd[21929]: DEBUG: Got incoming request with protocol version 2
renderd[21929]: DEBUG: Got command RenderBulk fd(27) xml(rumap_m), z(6), x(8), y(48), mime(image/png), options()
renderd[21929]: DEBUG: START TILE rumap_m 6 8-15 56-63, age 0.44 days
renderd[21929]: DEBUG: START TILE rumap_m 6 8-15 48-55, age 0.44 days
renderd[21929]: Rendering projected coordinates 6 8 56 -> -15028131.257100|-20037508.342800 -10018754.171400|-15028131.257100 to a 8 x 8 tile
renderd[21929]: Rendering projected coordinates 6 8 48 -> -15028131.257100|-15028131.257100 -10018754.171400|-10018754.171400 to a 8 x 8 tile
renderd[21929]: ERROR: failed to render TILE rumap_m 6 8-15 24-31
renderd[21929]:    reason: failed to initialize projection with: '+proj=merc +datum=WGS84 +over'
renderd[21929]: DEBUG: DONE TILE rumap_m 6 8-15 24-31 in 0.022 seconds
renderd[21929]: DEBUG: Sending render cmd(4) with protocol version 2
renderd[21929]: DEBUG: DONE TILE rumap_m 6 8-15 56-63 in 0.553 seconds

Andrey-VI avatar Dec 24 '13 06:12 Andrey-VI

In your case, it looks like rendering did actually fail:

"ERROR: failed to render TILE rumap_m 6 8-15 24-31 renderd[21929]: reason: failed to initialize projection with: '+proj=merc +datum=WGS84 +over'"

So the behavior of render_list to report that failure is correct. Therefore, this is likely a separate issue from the one previously observed.

Do you know why it might have failed to initialise the projection? Do non of the tiles of that layer render? Does it happen everytime with render_list? What is your command line argument for render_list?

apmon avatar Dec 24 '13 09:12 apmon

Therefore, this is likely a separate issue from the one previously observed.

Maybe. I'm not sure. But these errors appeared in the latest mod_tile revisions. Never seen them in older (summer) versions.

Do you know why it might have failed to initialise the projection?

No idea, but all my maps in EPSG:3395 projection (+proj=merc +datum=WGS84 +over). And every time after restarting renderd I see many lines Unknown projection string, using web mercator as never the less. +proj=merc +datum=WGS84 +over in daemon.log. But my maps are rendered in correct projection.

Do non of the tiles of that layer render?

Every time these errors appear in different amounts. For example:

                    errors
zoom    1-st attempt    2-nd attempt
6       1               0
7       1               1
8       0               2
9       8               1

What is your command line argument for render_list?

The command: render_list -a -f -m rumap_m -n 16 -t /raid/tiles -s /var/run/renderd/renderd.sock -z 0 -Z 0 -v && render_list -a -f -m rumap_m -n 16 -t /raid/tiles -s /var/run/renderd/renderd.sock -z 1 -Z 1 -v && render_list -a -f -m rumap_m -n 16 -t /raid/tiles -s /var/run/renderd/renderd.sock -z 2 -Z 2 -v && etc. until zoom level 9

Andrey-VI avatar Dec 24 '13 10:12 Andrey-VI

same error for me

A0x01 avatar Jan 17 '22 12:01 A0x01