openstreetmap-tile-server icon indicating copy to clipboard operation
openstreetmap-tile-server copied to clipboard
verified publisher icon Overv

UPDATES fail - Osmosis problem in logs causing container unexpected crash

Open leandronn opened this issue 2 years ago • 0 comments

This are the logs:

[2023-08-09 15:09:01] 2270 start import from seq-nr , replag is
[2023-08-09 15:09:01] 2270 downloading diff
Aug 09, 2023 3:09:02 PM org.openstreetmap.osmosis.core.Osmosis run
INFO: Osmosis Version 0.48.3
Aug 09, 2023 3:09:02 PM org.openstreetmap.osmosis.core.Osmosis run
INFO: Preparing pipeline.
tail: /var/log/tiles/osmosis.log: file truncated
Aug 09, 2023 3:09:02 PM org.openstreetmap.osmosis.core.Osmosis run
INFO: Launching pipeline execution.
Aug 09, 2023 3:09:02 PM org.openstreetmap.osmosis.core.Osmosis run
INFO: Pipeline executing, waiting for completion.
Aug 09, 2023 3:09:03 PM org.openstreetmap.osmosis.replication.v0_6.BaseReplicationDownloader runImpl
INFO: Reading current server state. [ReplicationState(timestamp=Wed Aug 09 15:00:00 GMT 2023, sequenceNumber=95600)]
[2023-08-09 15:09:04] 2270 [error] Osmosis error
[2023-08-09 15:09:04] 2270 resetting state
Aug 09, 2023 3:09:04 PM org.openstreetmap.osmosis.core.pipeline.common.ActiveTaskManager waitForCompletion
SEVERE: Thread for task 1-read-replication-interval failed
org.openstreetmap.osmosis.core.OsmosisRuntimeException: The replication state doesn't contain a timestamp property.
	at org.openstreetmap.osmosis.replication.common.ReplicationState.loadProperty(ReplicationState.java:65)
	at org.openstreetmap.osmosis.replication.common.ReplicationState.load(ReplicationState.java:78)
	at org.openstreetmap.osmosis.replication.common.ReplicationState.<init>(ReplicationState.java:59)
	at org.openstreetmap.osmosis.replication.v0_6.BaseReplicationDownloader.runImpl(BaseReplicationDownloader.java:290)
	at org.openstreetmap.osmosis.replication.v0_6.BaseReplicationDownloader.run(BaseReplicationDownloader.java:372)
	at java.base/java.lang.Thread.run(Thread.java:829)

Aug 09, 2023 3:09:04 PM org.openstreetmap.osmosis.core.Osmosis main
SEVERE: Execution aborted.
org.openstreetmap.osmosis.core.OsmosisRuntimeException: One or more tasks failed.
	at org.openstreetmap.osmosis.core.pipeline.common.Pipeline.waitForCompletion(Pipeline.java:146)
	at org.openstreetmap.osmosis.core.Osmosis.run(Osmosis.java:92)
	at org.openstreetmap.osmosis.core.Osmosis.main(Osmosis.java:37)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at org.codehaus.plexus.classworlds.launcher.Launcher.launchStandard(Launcher.java:321)
	at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:234)
	at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:406)
	at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:347)
	at org.codehaus.classworlds.Launcher.main(Launcher.java:47)

tail: /var/log/tiles/osmosis.log: file truncated
[2023-08-09 15:10:01] 2325 start import from seq-nr , replag is
[2023-08-09 15:10:01] 2325 downloading diff
Aug 09, 2023 3:10:01 PM org.openstreetmap.osmosis.core.Osmosis run
INFO: Osmosis Version 0.48.3
Aug 09, 2023 3:10:01 PM org.openstreetmap.osmosis.core.Osmosis run
INFO: Preparing pipeline.
Aug 09, 2023 3:10:01 PM org.openstreetmap.osmosis.core.Osmosis run
INFO: Launching pipeline execution.
Aug 09, 2023 3:10:01 PM org.openstreetmap.osmosis.core.Osmosis run
INFO: Pipeline executing, waiting for completion.
Aug 09, 2023 3:10:03 PM org.openstreetmap.osmosis.replication.v0_6.BaseReplicationDownloader runImpl
INFO: Reading current server state. [ReplicationState(timestamp=Wed Aug 09 15:00:00 GMT 2023, sequenceNumber=95600)]
[2023-08-09 15:10:04] 2325 [error] Osmosis error
[2023-08-09 15:10:04] 2325 resetting state
Aug 09, 2023 3:10:04 PM org.openstreetmap.osmosis.core.pipeline.common.ActiveTaskManager waitForCompletion
SEVERE: Thread for task 1-read-replication-interval failed
org.openstreetmap.osmosis.core.OsmosisRuntimeException: The replication state doesn't contain a timestamp property.
	at org.openstreetmap.osmosis.replication.common.ReplicationState.loadProperty(ReplicationState.java:65)
	at org.openstreetmap.osmosis.replication.common.ReplicationState.load(ReplicationState.java:78)
	at org.openstreetmap.osmosis.replication.common.ReplicationState.<init>(ReplicationState.java:59)
	at org.openstreetmap.osmosis.replication.v0_6.BaseReplicationDownloader.runImpl(BaseReplicationDownloader.java:290)
	at org.openstreetmap.osmosis.replication.v0_6.BaseReplicationDownloader.run(BaseReplicationDownloader.java:372)
	at java.base/java.lang.Thread.run(Thread.java:829)

Aug 09, 2023 3:10:04 PM org.openstreetmap.osmosis.core.Osmosis main
SEVERE: Execution aborted.
org.openstreetmap.osmosis.core.OsmosisRuntimeException: One or more tasks failed.
	at org.openstreetmap.osmosis.core.pipeline.common.Pipeline.waitForCompletion(Pipeline.java:146)
	at org.openstreetmap.osmosis.core.Osmosis.run(Osmosis.java:92)
	at org.openstreetmap.osmosis.core.Osmosis.main(Osmosis.java:37)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at org.codehaus.plexus.classworlds.launcher.Launcher.launchStandard(Launcher.java:321)
	at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:234)
	at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:406)
	at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:347)
	at org.codehaus.classworlds.Launcher.main(Launcher.java:47)

docker info:

Client: Docker Engine - Community
 Version:    24.0.5
 Context:    default
 Debug Mode: false
 Plugins:
  buildx: Docker Buildx (Docker Inc.)
    Version:  v0.11.2
    Path:     /usr/libexec/docker/cli-plugins/docker-buildx
  compose: Docker Compose (Docker Inc.)
    Version:  v2.20.2
    Path:     /usr/libexec/docker/cli-plugins/docker-compose

Server:
 Containers: 3
  Running: 2
  Paused: 0
  Stopped: 1
 Images: 2
 Server Version: 24.0.5
 Storage Driver: overlay2
  Backing Filesystem: extfs
  Supports d_type: true
  Using metacopy: false
  Native Overlay Diff: true
  userxattr: false
 Logging Driver: json-file
 Cgroup Driver: systemd
 Cgroup Version: 2
 Plugins:
  Volume: local
  Network: bridge host ipvlan macvlan null overlay
  Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog
 Swarm: inactive
 Runtimes: io.containerd.runc.v2 runc
 Default Runtime: runc
 Init Binary: docker-init
 containerd version: 8165feabfdfe38c65b599c4993d227328c231fca
 runc version: v1.1.8-0-g82f18fe
 init version: de40ad0
 Security Options:
  apparmor
  seccomp
   Profile: builtin
  cgroupns
 Kernel Version: 5.10.0-23-amd64
 Operating System: Debian GNU/Linux 11 (bullseye)
 OSType: linux
 Architecture: x86_64
 CPUs: 4
 Total Memory: 5.798GiB
 Name: osm
 ID: 6d2a562d-c02b-4f02-8e6c-9bd77dea2358
 Docker Root Dir: /var/lib/docker
 Debug Mode: false
 Experimental: false
 Insecure Registries:
  127.0.0.0/8
 Live Restore Enabled: false

It crashes randomly.

I followed the instrunctions in the readme like this:

docker run     --name osm-server     -p 8080:80     -e REPLICATION_URL=https://planet.openstreetmap.org/replication/minute/     -e MAX_INTERVAL_SECONDS=60     -e UPDATES=enabled     -v /home/leandro/argentina-latest.osm.pbf:/data/region.osm.pbf     -v osm-data:/data/database/     -v osm-tiles:/data/tiles/     -d overv/openstreetmap-tile-server     run

uname -a

 Linux osm 5.10.0-23-amd64 #1 SMP Debian 5.10.179-3 (2023-07-27) x86_64 GNU/Linux

It also crashes a nominatim container I have.

Thanks in advance.

leandronn avatar Aug 09 '23 15:08 leandronn