Same config, same domain - errors

Open zilexa opened this issue 10 months ago • 0 comments

I switched from docker on Manjaro to podman rootless on Bluefin OS (Fedora Silverblue 41).

Lowered unprivileged ports, opened port 80 and 443 via firewalld. I am getting errors that I never had before. I did not change my compose file.

BUT: I did start fresh with nocaddy_data and config folders. so it is a fresh start.

  caddy-proxy:
    container_name: caddy-proxy
    image: lucaslorentz/caddy-docker-proxy:ci-alpine
    privileged: true
    restart: always
    networks: 
      - caddy-net
    environment:
      - CADDY_INGRESS_NETWORKS=caddy-net
      - CADDY_DOCKER_NO_SCOPE=true
    volumes:
      - /run/user/1000/podman/podman.sock:/var/run/docker.sock
      - $DOCKERDIR/network/caddy-proxy/caddy_data:/data:Z
      - $DOCKERDIR/network/caddy-proxy/config:/config:Z
    ports:
      - 443:443
      - 80:80
    labels:
      caddy.email: $EMAIL

log shows it is failing, and eventually hitting rate limiter for ACME challenge. Not sure why it uses that method. I thought it used a different method first.

ock","identifier":"office.obelix.cloud"}

{"level":"info","ts":1738874135.8674781,"logger":"tls.obtain","msg":"acquiring lock","identifier":"drive.obelix.cloud"}

{"level":"info","ts":1738874135.867783,"logger":"tls.obtain","msg":"acquiring lock","identifier":"vault.obelix.cloud"}

{"level":"error","ts":1738874135.868419,"logger":"tls.obtain","msg":"could not get certificate from issuer","identifier":"vault.obelix.cloud","issuer":"acme-v02.api.letsencrypt.org-directory","error":"context canceled"}

{"level":"error","ts":1738874135.8685176,"logger":"tls.obtain","msg":"could not get certificate fr
r","identifier":"vault.obelix.cloud","issuer":"acme.zerossl.com-v2-DV90","error":"account pre-registration callback: performing EAB credentials request: Post \"https://api.zerossl.com/acme/eab-credentials-email\": context canceled"}

{"level":"error","ts":1738874135.8685424,"logger":"tls.obtain","msg":"will retry","error":"[vault.obelix.cloud] Obtain: account pre-registration callback: performing EAB credentials request: Post \"https://api.zerossl.com/acme/eab-credentials-email\": context canceled","attempt":1,"retrying_in":60,"elapsed":0.264911564,"max_duration":2592000}

{"level":"info","ts":1738874135.8685482,"logger":"tls.obtain","msg":"releasing lock","identifier":"vault.obelix.cloud"}

{"level":"error","ts":1738874135.868592,"logger":"tls","msg":"job failed","error":"vault.obelix.cloud: obtaining certificate: context canceled"}

{"level":"error","ts":1738874135.868599,"logger":"tls.obtain","msg":"could not get certificate from issuer","identifier":"office.obelix.cloud","issuer":"acme-v02.api.letsencrypt.org-directory","error":"context canceled"}

{"level":"error","ts":1738874135.868657,"logger":"tls.obtain","msg":"could not get certificate from issuer","identifier":"office.obelix.cloud","issuer":"acme.zerossl.com-v2-DV90","error":"account pre-registration callback: performing EAB credentials request: Post \"https://api.zerossl.com/acme/eab-credentials-email\": context canceled"}

{"level":"error","ts":1738874135.8686707,"logger":"tls.obtain","msg":"will retry","error":"[office.obelix.cloud] Obtain: account pre-registration callback: performing EAB credentials request: Post \"https://api.zerossl.com/acme/eab-credentials-email\": context canceled","attempt":1,"retrying_in":60,"elapsed":0.269549521,"max_duration":2592000}

{"level":"info","ts":1738874135.8686755,"logger":"tls.obtain","msg":"releasing lock","identifier":"office.obelix.cloud"}

{"level":"error","ts":1738874135.8687098,"logger":"tls","msg":"job failed","error":"office.obelix.cloud: obtaining certificate: context canceled"}

{"level":"info","ts":1738874135.869881,"msg":"autosaved config (load with --resume flag)","file":"/config/caddy/autosave.json"}

{"level":"info","ts":1738874135.8698978,"logger":"admin.api","msg":"load complete"}

{"level":"info","ts":1738874135.8700082,"logger":"docker-proxy","msg":"Successfully configured","server":"localhost"}

{"level":"info","ts":1738874135.8725407,"logger":"tls.obtain","msg":"lock acquired","identifier":"drive.obelix.cloud"}

{"level":"info","ts":1738874135.8727345,"logger":"tls.obtain","msg":"obtaining certificate","identifier":"drive.obelix.cloud"}

{"level":"info","ts":1738874135.87312,"logger":"tls.issuance.acme","msg":"waiting on internal rate limiter","identifiers":["drive.obelix.cloud"],"ca":"https://acme-v02.api.letsencrypt.org/directory","account":"[email protected]"}

{"level":"info","ts":1738874135.8732202,"logger":"admin","msg":"stopped previous server","address":"localhost:2019"}

{"level":"info","ts":1738874136.2402997,"logger":"docker-proxy","msg":"New Caddyfile","caddyfile":"{\n\temail [email protected]\n}\ndrive.obelix.cloud {\n\tencode gzip\n\tfile_server\n\theader {\n\t\tStrict-Transport-Security max-age=15768000;\n\t\tX-Content-Type-Options nosniff\n\t\tX-Frame-Options SAMEORIGIN\n\t\tX-XSS-Protection \"1; mode=block;\"\n\t}\n\treverse_proxy 10.89.0.118:80 {\n\t\theader_up Host drive.obelix.cloud\n\t}\n}\nhttp://bazarr.o {\n\treverse_proxy 10.89.0.104:6767\n}\nhttp://jellyfin.o {\n\treverse_proxy 10.89.0.85:8096\n}\nhttp://lidarr.o {\n\treverse_proxy 10.89.0.96:8686\n}\nhttp://radarr.o {\n\treverse_proxy 10.89.0.93:7878\n}\nhttp://solverr.o {\n\treverse_proxy 10.89.0.87:8191\n}\nhttp://sonarr.o {\n\treverse_proxy 10.89.0.90:8989\n}\nhttp://torrents.o {\n\treverse_proxy 10.89.0.86:9696\n}\noffice.obelix.cloud {\n\tencode gzip\n\treverse_proxy 10.89.0.99:80\n}\nvault.obelix.cloud {\n\tencode gzip\n\theader {\n\t\tX-Content-Type-Options none\n\t\tX-Frame-Options DENY\n\t\tX-XSS-Protection \"1; mode=block;\"\n\t}\n\treverse_proxy /notifications/hub 10.89.0.84:3012\n\treverse_proxy /notifications/hub/negotiate 10.89.0.84:80\n\treverse_proxy 10.89.0.84:80\n}\n"}

{"level":"info","ts":1738874136.242354,"logger":"docker-proxy","msg":"New Config JSON","json":"{\"apps\":{\"http\":{\"servers\":{\"srv0\":{\"listen\":[\":443\"],\"routes\":[{\"match\":[{\"host\":[\"office.obelix.cloud\"]}],\"handle\":[{\"handler\":\"subroute\",\"routes\":[{\"handle\":[{\"encodings\":{\"gzip\":{}},\"handler\":\"encode\",\"prefer\":[\"gzip\"]},{\"handler\":\"reverse_proxy\",\"upstreams\":[{\"dial\":\"10.89.0.99:80\"}]}]}]}],\"terminal\":true},{\"match\":[{\"host\":[\"drive.obelix.cloud\"]}],\"handle\":[{\"handler\":\"subroute\",\"routes\":[{\"handle\":[{\"handler\":\"headers\",\"response\":{\"set\":{\"Strict-Transport-Security\":[\"max-age=15768000;\"],\"X-Content-Type-Options\":[\"nosniff\"],\"X-Frame-Options\":[\"SAMEORIGIN\"],\"X-Xss-Protection\":[\"1; mode=block;\"]}}},{\"encodings\":{\"gzip\":{}},\"handler\":\"encode\",\"prefer\":[\"gzip\"]},{\"handler\":\"reverse_proxy\",\"headers\":{\"request\":{\"set\":{\"Host\":[\"drive.obelix.cloud\"]}}},\"upstreams\":[{\"dial\":\"10.89.0.118:80\"}]},{\"handler\":\"file_server\",\"hide\":[\"./Caddyfile\"]}]}]}],\"terminal\":true},{\"match\":[{\"host\":[\"vault.obelix.cloud\"]}],\"handle\":[{\"handler\":\"subroute\",\"routes\":[{\"handle\":[{\"handler\":\"headers\",\"response\":{\"set\":{\"X-Content-Type-Options\":[\"none\"],\"X-Frame-Options\":[\"DENY\"],\"X-Xss-Protection\":[\"1; mode=block;\"]}}},{\"encodings\":{\"gzip\":{}},\"handler\":\"encode\",\"prefer\":[\"gzip\"]}]},{\"handle\":[{\"handler\":\"reverse_proxy\",\"upstreams\":[{\"dial\":\"10.89.0.84:80\"}]}],\"match\":[{\"path\":[\"/notifications/hub/negotiate\"]}]},{\"handle\":[{\"handler\":\"reverse_proxy\",\"upstreams\":[{\"dial\":\"10.89.0.84:3012\"}]}],\"match\":[{\"path\":[\"/notifications/hub\"]}]},{\"handle\":[{\"handler\":\"reverse_proxy\",\"upstreams\":[{\"dial\":\"10.89.0.84:80\"}]}]}]}],\"terminal\":true}]},\"srv1\":{\"listen\":[\":80\"],\"routes\":[{\"match\":[{\"host\":[\"jellyfin.o\"]}],\"handle\":[{\"handler\":\"subroute\",\"routes\":[{\"handle\":[{\"handler\":\"reverse_proxy\
reams\":[{\"dial\":\"10.89.0.85:8096\"}]}]}]}],\"terminal\":true},{\"match\":[{\"host\":[\"torrents.o\"]}],\"handle\":[{\"handler\":\"subroute\",\"routes\":[{\"handle\":[{\"handler\":\"reverse_proxy\",\"upstreams\":[{\"dial\":\"10.89.0.86:9696\"}]}]}]}],\"terminal\":true},{\"match\":[{\"host\":[\"solverr.o\"]}],\"handle\":[{\"handler\":\"subroute\",\"routes\":[{\"handle\":[{\"handler\":\"reverse_proxy\",\"upstreams\":[{\"dial\":\"10.89.0.87:8191\"}]}]}]}],\"terminal\":true},{\"match\":[{\"host\":[\"bazarr.o\"]}],\"handle\":[{\"handler\":\"subroute\",\"routes\":[{\"handle\":[{\"handler\":\"reverse_proxy\",\"upstreams\":[{\"dial\":\"10.89.0.104:6767\"}]}]}]}],\"terminal\":true},{\"match\":[{\"host\":[\"lidarr.o\"]}],\"handle\":[{\"handler\":\"subroute\",\"routes\":[{\"handle\":[{\"handler\":\"reverse_proxy\",\"upstreams\":[{\"dial\":\"10.89.0.96:8686\"}]}]}]}],\"terminal\":true},{\"match\":[{\"host\":[\"radarr.o\"]}],\"handle\":[{\"handler\":\"subroute\",\"routes\":[{\"handle\":[{\"handler\":\"reverse_proxy\",\"upstreams\":[{\"dial\":\"10.89.0.93:7878\"}]}]}]}],\"terminal\":true},{\"match\":[{\"host\":[\"sonarr.o\"]}],\"handle\":[{\"handler\":\"subroute\",\"routes\":[{\"handle\":[{\"handler\":\"reverse_proxy\",\"upstreams\":[{\"dial\":\"10.89.0.90:8989\"}]}]}]}],\"terminal\":true}]}}},\"tls\":{\"automation\":{\"policies\":[{\"subjects\":[\"office.obelix.cloud\",\"drive.obelix.cloud\",\"vault.obelix.cloud\"],\"issuers\":[{\"email\":\"[email protected]\",\"module\":\"acme\"},{\"ca\":\"https://acme.zerossl.com/v2/DV90\",\"email\":\"[email protected]\",\"module\":\"acme\"}]}]}}}}"}

{"level":"info","ts":1738874136.2426178,"logger":"docker-proxy","msg":"Sending configuration to","server":"localhost"}

{"level":"info","ts":1738874136.2435055,"logger":"admin.api","msg":"received request","method":"POST","host":"localhost:2019","uri":"/load","remote_ip":"127.0.0.1","remote_port":"46004","headers":{"Accept-Encoding":["gzip"
nt-Length":["3123"],"Content-Type":["application/json"],"User-Agent":["Go-http-client/1.1"]}}

{"level":"info","ts":1738874136.2443612,"logger":"admin","msg":"admin endpoint started","address":"localhost:2019","enforce_origin":false,"origins":["//[::1]:2019","//127.0.0.1:2019","//localhost:2019"]}

{"level":"info","ts":1738874136.2446914,"logger":"http.auto_https","msg":"server is listening only on the HTTPS port but has no TLS connection policies; adding one to enable TLS","server_name":"srv0","https_port":443}

{"level":"info","ts":1738874136.244792,"logger":"http.auto_https","msg":"enabling automatic HTTP->HTTPS redirects","server_name":"srv0"}

{"level":"warn","ts":1738874136.2448921,"logger":"http.auto_https","msg":"server is listening only on the HTTP port, so no automatic HTTPS will be applied to this server","server_name":"srv1","http_port":80}

{"level":"info","ts":1738874136.2457268,"logger":"http","msg":"enabling HTTP/3 listener","addr":":443"}

{"level":"info","ts":1738874136.2458415,"logger":"http.log","msg":"server running","name":"srv0","protocols":["h1","h2","h3"]}

{"level":"info","ts":1738874136.246007,"logger":"http.log","msg":"server running","name":"srv1","protocols":["h1","h2","h3"]}

{"level":"info","ts":1738874136.24612,"logger":"http","msg":"enabling automatic TLS certificate management","domains":["office.obelix.cloud","drive.obelix.cloud","vault.obelix.cloud"]}

{"level":"info","ts":1738874136.2465544,"logger":"tls.obtain","msg":"acquiring lock","identifier":"office.obelix.cloud"}

{"level":"info","ts":1738874136.2468154,"logger":"tls.obtain","msg":"acquiring lock","identifier":"drive.obelix.cloud"}

{"level":"info","ts":1738874136.2470186,"logger":"tls.obtain","msg":"acquiring lock","identifier":"vault.obelix.cloud"}

{"level":"info","ts":1738874136.246325,"logger":"http","msg":"servers shutting down with eternal grace period"}

{"level":"info","ts":1738874136.2474582,"msg":"autosaved config (load with --resume flag)","file":"/config/caddy/autosave.json"}

{"level":"info","ts":1738874136.2474635,"logger":"admin.api","msg":"load complete"}

{"level":"error","ts":1738874136.2475307,"logger":"tls.obtain","msg":"could not get certificate from issuer","identifier":"drive.obelix.cloud","issuer":"acme-v02.api.letsencrypt.org-directory","error":"context canceled"}

{"level":"error","ts":1738874136.2476206,"logger":"tls.obtain","msg":"could not get certificate from issuer","identifier":"drive.obelix.cloud","issuer":"acme.zerossl.com-v2-DV90","error":"account pre-registration callback: performing EAB credentials request: Post \"https://api.zerossl.com/acme/eab-credentials-email\": context canceled"}

{"level":"error","ts":1738874136.247645,"logger":"tls.obtain","msg":"will retry","error":"[drive.obelix.cloud] Obtain: account pre-registration callback: performing EAB credentials request: Post \"https://api.zerossl.com/acme/eab-credentials-email\": context canceled","attempt":1,"retrying_in":60,"elapsed":0.375086159,"max_duration":2592000}

{"level":"info","ts":1738874136.247651,"logger":"tls.obtain","msg":"releasing lock","identifier":"drive.obelix.cloud"}

{"level":"error","ts":1738874136.2477026,"logger":"tls","msg":"job failed","error":"drive.obelix.cloud: obtaining certificate: context canceled"}

{"level":"error","ts":1738874136.2477083,"logger":"tls","msg":"job failed","error":"vault.obelix.cloud: obtaining certificate: unable to acquire lock 'issue_cert_vault.obelix.cloud': context canceled"}

{"level":"error","ts":1738874136.2477114,"logger":"tls","msg":"job failed","error":"office.obelix.cloud: obtaining certificate: unable to acquire lock 'issue_cert_office.obelix.cloud': context canceled"}

{"level":"info","ts":1738874136.24847,"logger":"docker-proxy","msg":"Successfully configured","server":"localhost"}

{"level":"info","ts":1738874136.2484882,"logger":"admin","msg":"stopped previous server","address":"localhost:2019"}

{"level":"info","ts":1738874136.2521458,"logger":"tls.obtain","msg":"lock acquired","identifier":"vault.obelix.cloud"}

{"level":"info","ts":1738874136.2524145,"logger":"tls.obtain","msg":"obtaining certificate","identifier":"vault.obelix.cloud"}

{"level":"info","ts":1738874136.2527826,"logger":"tls.issuance.acme","msg":"waiting on internal rate limiter","identifiers":["vault.obelix.cloud"],"ca":"https://acme-v02.api.letsencrypt.org/directory","account":"[email protected]"}

{"level":"info","ts":1738874136.2547364,"logger":"tls.obtain","msg":"lock acquired","identifier":"office.obelix.cloud"}

{"level":"info","ts":1738874136.2549546,"logger":"tls.obtain","msg":"obtaining certificate","identifier":"office.obelix.cloud"}

{"level":"info","ts":1738874136.2552478,"logger":"tls.issuance.acme","msg":"waiting on internal rate limiter","identifiers":["office.obelix.cloud"],"ca":"https://acme-v02.api.letsencrypt.org/directory","account":"[email protected]"}

{"level":"info","ts":1738874136.514266,"logger":"docker-proxy","msg":"New Caddyfile","caddyfile":"{\n\temail [email protected]\n}\nhttp://bazarr.o {\n\treverse_proxy 10.89.0.104:6767\n}\nhttp://jellyfin.o {\n\treverse_proxy 10.89.0.85:8096\n}\nhttp://lidarr.o {\n\treverse_proxy 10.89.0.96:8686\n}\nhttp://radarr.o {\n\treverse_proxy 10.89.0.93:7878\n}\nhttp://solverr.o {\n\treverse_proxy 10.89.0.87:8191\n}\nhttp://sonarr.o {\n\treverse_proxy 10.89.0.90:8989\n}\nhttp://torrents.o {\n\treverse_proxy 10.89.0.86:9696\n}\noffice.obelix.cloud {\n\tencode gzip\n\treverse_proxy 10.89.0.99:80\n}\nvault.obelix.cloud {\n\tencode gzip\n\theader {\n\t\tX-Content-Type-Options none\n\t\tX-Frame-Options DENY\n\t\tX-XSS-Protection \"1; mode=block;\"\n\t}\n\treverse_proxy /notifications/hub 10.89.0.84:3012\n\treverse_proxy /notifications/hub/negotiate 10.89.0.84:80\n\treverse_proxy 10.89.0.84:80\n}\n"}

{"level":"info","ts":1738874136.5156565,"logger":"docker-proxy","msg":"New Config JSON","json":"{\"apps\":{\"http\":{\"servers\":{\"srv0\":{\"listen\":[\":443\"],\"routes\":[{\"match\":[{\"host\":[\"office.obelix.cloud\"]}],\"handle\":[{\"handler\":\"subroute\",\"routes\":[{\"handle\":[{\"encodings\":{\"gzip\":{}},\"handler\":\"encode\",\"prefer\":[\"gzip\"]},{\"handler\":\"reverse_proxy\",\"upstreams\":[{\"dial\":\"10.89.0.99:80\"}]}]}]}],\"terminal\":true},{\"match\":[{\"host\":[\"vault.obelix.cloud\"]}],\"handle\":[{\"handler\":\"subroute\",\"routes\":[{\"handle\":[{\"handler\":\"headers\",\"response\":{\"set\":{\"X-Content-Type-Options\":[\"none\"],\"X-Frame-Options\":[\"DENY\"],\"X-Xss-Protection\":[\"1; mode=block;\"]}}},{\"encodings\":{\"gzip\":{}},\"handler\":\"encode\",\"prefer\":[\"gzip\"]}]},{\"handle\":[{\"handler\":\"reverse_proxy\",\"upstreams\":[{\"dial\":\"10.89.0.84:80\"}]}],\"match\":[{\"path\":[\"/notifications/hub/negotiate\"]}]},{\"handle\":[{\"handler\":\"reverse_proxy\",\"upstreams\":[{\"dial\":\"10.89.0.84:3012\"}]}],\"match\":[{\"path\":[\"/notifications/hub\"]}]},{\"handle\":[{\"handler\":\"reverse_proxy\",\"upstreams\":[{\"dial\":\"10.89.0.84:80\"}]}]}]}],\"terminal\":true}]},\"srv1\":{\"listen\":[\":80\"],\"routes\":[{\"match\":[{\"host\":[\"jellyfin.o\"]}],\"handle\":[{\"handler\":\"subroute\",\"routes\":[{\"handle\":[{\"handler\":\"reverse_proxy\",\"upstreams\":[{\"dial\":\"10.89.0.85:8096\"}]}]}]}],\"terminal\":true},{\"match\":[{\"host\":[\"torrents.o\"]}],\"handle\":[{\"handler\":\"subroute\",\"routes\":[{\"handle\":[{\"handler\":\"reverse_proxy\",\"upstreams\":[{\"dial\":\"10.89.0.86:9696\"}]}]}]}],\"terminal\":true},{\"match\":[{\"host\":[\"solverr.o\"]}],\"handle\":[{\"handler\":\"subroute\",\"routes\":[{\"handle\":[{\"handler\":\"reverse_proxy\",\"upstreams\":[{\"dial\":\"10.89.0.87:8191\"}]}]}]}],\"terminal\":true},{\"match\":[{\"host\":[\"bazarr.o\"]}],\"handle\":[{\"handler\":\"subroute\",\"routes\":[{\"handle\":[{\"handler\":\"reverse_proxy\",\"upstreams\":[{\"dial
89.0.104:6767\"}]}]}]}],\"terminal
,{\"match\":[{\"host\":[\"lidarr.o\"]}],\"handle\":[{\"handler\":\"subroute\",\"routes\":[{\"handle\":[{\"handler\":\"reverse_proxy\",\"upstreams\":[{\"dial\":\"10.89.0.96:8686\"}]}]}]}],\"terminal\":true},{\"match\":[{\"host\":[\"radarr.o\"]}],\"handle\":[{\"handler\":\"subroute\",\"routes\":[{\"handle\":[{\"handler\":\"reverse_proxy\",\"upstreams\":[{\"dial\":\"10.89.0.93:7878\"}]}]}]}],\"terminal\":true},{\"match\":[{\"host\":[\"sonarr.o\"]}],\"handle\":[{\"handler\":\"subroute\",\"routes\":[{\"handle\":[{\"handler\":\"reverse_proxy\",\"upstreams\":[{\"dial\":\"10.89.0.90:8989\"}]}]}]}],\"terminal\":true}]}}},\"tls\":{\"automation\":{\"policies\":[{\"subjects\":[\"office.obelix.cloud\",\"vault.obelix.cloud\"],\"issuers\":[{\"email\":\"[email protected]\",\"module\":\"acme\"},{\"ca\":\"https://acme.zerossl.com/v2/DV90\",\"email\":\"[email protected]\",\"module\":\"acme\"}]}]}}}}"}

{"level":"info","ts":1738874136.5156856,"logger":"docker-proxy","msg":"Sending configuration to","server":"localhost"}

{"level":"info","ts":1738874136.516323,"logger":"admin.api","msg":"received request","method":"POST","host":"localhost:2019","uri":"/load","remote_ip":"127.0.0.1","remote_port":"46020","headers":{"Accept-Encoding":["gzip"],"Content-Length":["2541"],"Content-Type":["application/json"],"User-Agent":["Go-http-client/1.1"]}}

{"level":"info","ts":1738874136.5170531,"logger":"admin","msg":"admin endpoint started","address":"localhost:2019","enforce_origin":false,"origins":["//localhost:2019","//[::1]:2019","//127.0.0.1:2019"]}

{"level":"info","ts":1738874136.5172884,"logger":"http.auto_https","msg":"server is listening only on the HTTPS port but has no TLS connection policies; adding one to enable TLS","server_name":"srv0","https_port":443}

{"level":"info","ts":1738874136.5173008,"logger":"http.auto_https","msg":"enabling automatic HTTP->HTTPS redirects","server_name":"srv0"}

{"level":"warn","ts":1738874136.5173223,"logger":"http.auto_https","msg":"server is listening only on the HTTP port, so no automatic HTTPS will be applied to this server","server_name":"srv1","http_port":80}

{"level":"info","ts":1738874136.517698,"logger":"http","msg":"enabling HTTP/3 listener","addr":":443"}

{"level":"info","ts":1738874136.5177119,"logger":"http.log","msg":"server running","name":"srv0","protocols":["h1","h2","h3"]}

{"level":"info","ts":1738874136.5177355,"logger":"http.log","msg":"server running","name":"srv1","protocols":["h1","h2","h3"]}

{"level":"info","ts":1738874136.5177402,"logger":"http","msg":"enabling automatic TLS certificate management","domains":["office.obelix.cloud","vault.obelix.cloud"]}

{"level":"info","ts":1738874136.5178118,"logger":"http","msg":"servers shutting down with eternal grace period"}

{"level":"info","ts":1738874136.5180771,"logger":"tls.obtain","msg":"acquiring lock","identifier":"office.obelix.cloud"}

{"level":"info","ts":1738874136.5182703,"logger":"tls.obtain","msg":"acquiring lock","identifier":"vault.obelix.cloud"}

{"level":"info","ts":1738874136.5183876,"msg":"autosaved config (load with --resume flag)","file":"/config/caddy/autosave.json"}

{"level":"info","ts":1738874136.5183923,"logger":"admin.api","msg":"load complete"}

{"level":"error","ts":1738874136.5184493,"logger":"tls.obtain","msg":"could not get certificate from issuer","identifier":"office.obelix.cloud","issuer":"acme-v02.api.letsencrypt.org-directory","error":"context canceled"}

{"level":"error","ts":1738874136.5185332,"logger":"tls.obtain","msg":"could not get certificate from issuer","identifier":"office.obelix.cloud","issuer":"acme.zerossl.com-v2-DV90","error":"account pre-registration callback: performing EAB credentials request: Post \"https://api.zerossl.com/acme/eab-credentials-email\": context canceled"}

{"level":"error","ts":1738874136.5185564,"logger":"tls.obtain","msg":"will retry","error":"[office.obelix.cloud] Obtain: account pre-registration callback: performing EAB credentials request: Post \"https://api.zerossl.com/acme/eab-credentials-email\": context canceled","attempt":1,"retrying_in":60,"elapsed":0.263685391,"max_duration":2592000}

{"level":"info","ts":1738874136.5185628,"logger":"tls.obtain","msg":"releasing lock","identifier":"office.obelix.cloud"}

{"level":"error","ts":1738874136.5186017,"logger":"tls","msg":"job failed","error":"office.obelix.cloud: obtaining certificate: context canceled"}

{"level":"error","ts":1738874136.51861,"logger":"tls.obtain","msg":"could not get certificate from issuer","identifier":"vault.obelix.cloud","issuer":"acme-v02.api.letsencrypt.org-directory","error":"context canceled"}

{"level":"error","ts":1738874136.5186698,"logger":"tls.obtain","msg":"could not get certificate from issuer","identifier":"vault.obelix.cloud","issuer":"acme.zerossl.com-v2-DV90","error":"account pre-registration callback: performing EAB credentials request: Post \"https://api.zerossl.com/acme/eab-credentials-email\": context canceled"}

{"level":"error","ts":1738874136.5186841,"logger":"tls.obtain","msg":"will retry","error":"[vault.obelix.cloud] Obtain: account pre-registration callback: performing EAB credentials request: Post \"https://api.zerossl.com/acme/eab-credentials-email\": context canceled","attempt":1,"retrying_in":60,"elapsed":0.266348704,"max_duration":2592000}

{"level":"info","ts":1738874136.5186884,"logger":"tls.obtain","msg":"releasing lock","identifier":"vault.obelix.cloud"}

{"level":"error","ts":1738874136.5187206,"logger":"tls","msg":"job failed","error":"vault.obelix.cloud: obtaining certificate: context canceled"}

{"level":"error","ts":1738874136.518726,"logger":"tls","msg":"job failed","error":"drive.obelix.cloud: obtaining certificate: unable to acquire lock 'issue_cert_drive.obelix.cloud': context canceled"}

{"level":"info","ts":1738874136.5187788,"logger":"docker-proxy","msg":"Successfully configured","server":"localhost"}

{"level":"info","ts":1738874136.5190687,"logger":"admin","msg":"stopped previous server","address":"localhost:2019"}

{"level":"info","ts":1738874137.522564,"logger":"tls.obtain","msg":"lock acquired","identifier":"office.obelix.cloud"}

{"level":"info","ts":1738874137.522653,"logger":"tls.obtain","msg":"lock acquired","identifier":"vault.obelix.cloud"}

{"level":"info","ts":1738874137.5226784,"logger":"tls.obtain","msg":"obtaining certificate","identifier":"office.obelix.cloud"}

{"level":"info","ts":1738874137.5227349,"logger":"tls.obtain","msg":"obtaining certificate","identifier":"vault.obelix.cloud"}

{"level":"info","ts":1738874137.5229683,"logger":"tls.issuance.acme","msg":"waiting on internal rate limiter","identifiers":["office.obelix.cloud"],"ca":"https://acme-v02.api.letsencrypt.org/directory","account":"[email protected]"}

{"level":"info","ts":1738874137.5229719,"logger":"tls.issuance.acme","msg":"waiting on internal rate limiter","identifiers":["vault.obelix.cloud"],"ca":"https://acme-v02.api.letsencrypt.org/directory","account":"[email protected]"}

{"level":"info","ts":1738874137.5229754,"logger":"tls.issuance.acme","msg":"done waiting on internal rate limiter","identifiers":["office.obelix.cloud"],"ca":"https://acme-v02.api.letsencrypt.org/directory","account":"[email protected]"}

{"level":"info","ts":1738874137.5229855,"logger":"tls.issuance.acme","msg":"using ACME account","account_id":"https://acme-v02.api.letsencrypt.org/acme/acct/2213713405","account_contact":["mailto:[email protected]"]}

{"level":"info","ts":1738874138.1188962,"logger":"tls.issuance.acme","msg":"done waiting on internal rate limiter","identifiers":["vault.obelix.cloud"],"ca":"https://acme-v02.api.letsencrypt.org/directory","account":"[email protected]"}

{"level":"info","ts":1738874138.1265934,"logger":"tls.issuance.acme","msg":"using ACME account","account_id":"https://acme-v02.api.letsencrypt.org/acme/acct/2213713405","account_contact":["mailto:[email protected]"]}

{"level":"info","ts":1738874139.0687866,"logger":"tls.issuance.acme.acme_client","msg":"trying to solve challenge","identifier":"office.obelix.cloud","challenge_type":"tls-alpn-01","ca":"https://acme-v02.api.letsencrypt.org/directory"}

{"level":"info","ts":1738874139.0688384,"logger":"tls.issuance.acme.acme_client","msg":"trying to solve challenge","identifier":"vault.obelix.cloud","challenge_type":"tls-alpn-01","ca":"https://acme-v02.api.letsencrypt.org/directory"}

{"level":"error","ts":1738874140.0497687,"logger":"tls.issuance.acme.acme_client","msg":"challenge failed","identifier":"vault.obelix.cloud","challenge_type":"tls-alpn-01","problem":
"urn:ietf:params:acme:error:connection","title":"","detail":"86.93.76.50: Error getting validation data","instance":"","subproblems":[]}}

{"level":"error","ts":1738874140.0499482,"logger":"tls.issuance.acme.acme_client","msg":"validating authorization","identifier":"vault.obelix.cloud","problem":{"type":"urn:ietf:params:acme:error:connection","title":"","detail":"86.93.76.50: Error getting validation data","instance":"","subproblems":[]},"order":"https://acme-v02.api.letsencrypt.org/acme/order/2213713405/351852164945","attempt":1,"max_attempts":3}

{"level":"error","ts":1738874140.0500462,"logger":"tls.issuance.acme.acme_client","msg":"challenge failed","identifier":"office.obelix.cloud","challenge_type":"tls-alpn-01","problem":{"type":"urn:ietf:params:acme:error:connection","title":"","detail":"86.93.76.50: Error getting validation data","instance":"","subproblems":[]}}

{"level":"error","ts":1738874140.050055,"logger":"tls.issuance.acme.acme_client","msg":"validating authorization","identifier":"office.obelix.cloud","problem":{"type":"urn:ietf:params:acme:error:connection","title":"","detail":"86.93.76.50: Error getting validation data","instance":"","subproblems":[]},"order":"https://acme-v02.api.letsencrypt.org/acme/order/2213713405/351852164635","attempt":1,"max_attempts":3}

{"level":"error","ts":1738874141.221839,"logger":"tls.obtain","msg":"could not get certificate from issuer","identifier":"vault.obelix.cloud","issuer":"acme-v02.api.letsencrypt.org-directory","error":"HTTP 429 urn:ietf:params:acme:error:rateLimited - too many failed authorizations (5) for \"vault.obelix.cloud\" in the last 1h0m0s, retry after 2025-02-06 20:47:33 UTC: see https://letsencrypt.org/docs/rate-limits/#authorization-failures-per-hostname-per-account"}

{"level":"info","ts":1738874141.3942425,"logger":"tls.issuance.acme.acme_client","msg":"trying to solve challenge","identifier":"office.obelix.cloud","challenge_type":"http-01","ca":"https://acme-v02.api.letsencrypt.org/directory"}

{"level":"error","ts":1738874142.356626,"logger":"tls.issuance.acme.acme_client","msg":"challenge failed","identifier":"office.obelix.cloud","challenge_type":"http-01","problem":{"type":"urn:ietf:params:acme:error:connection","title":"","detail":"86.93.76.50: Fetching http://office.obelix.cloud/.well-known/acme-challenge/76HAM6-8ysYG-PaxjpNWB2X1SyhNKdlum9llgv1k2aA: Error getting validation data","instance":"","subproblems":[]}}

{"level":"error","ts":1738874142.3567908,"logger":"tls.issuance.acme.acme_client","msg":"validating authorization","identifier":"office.obelix.cloud","problem":{"type":"urn:ietf:params:acme:error:connection","title":"","detail":"86.93.76.50: Fetching http://office.obelix.cloud/.well-known/acme-challenge/76HAM6-8ysYG-PaxjpNWB2X1SyhNKdlum9llgv1k2aA: Error getting validation data","instance":"","subproblems":[]},"order":"https://acme-v02.api.letsencrypt.org/acme/order/2213713405/351852171825","attempt":2,"max_attempts":3}

{"level":"error","ts":1738874142.35681,"logger":"tls.obtain","msg":"could not get certificate from issuer","identifier":"office.obelix.cloud","issuer":"acme-v02.api.letsencrypt.org-directory","error":"HTTP 400 urn:ietf:params:acme:error:connection - 86.93.76.50: Fetching http://office.obelix.cloud/.well-known/acme-challenge/76HAM6-8ysYG-PaxjpNWB2X1SyhNKdlum9llgv1k2aA: Error getting validation data"}

{"level":"info","ts":1738874142.7973151,"logger":"http","msg":"generated EAB credentials","key_id":"5JCbkwUbAVTwtJg99maMoQ"}

{"level":"info","ts":1738874144.6333573,"logger":"tls.issuance.acme","msg":"waiting on internal rate limiter","identifiers":["office.obelix.cloud"],"ca":"https://acme.zerossl.com/v2/DV90","account":"[email protected]"}

{"level":"info","ts":1738874144.6372776,"logger":"tls.issuance.acme","msg":"done waiting on internal rate limiter","identifiers":["office.obelix.cloud"],"ca":"https://acme.zerossl.com/v2/DV90","account":"[email protected]"}

{"level":"info","ts":1738874144.6389253,"logger":"tls.issuance.acme","msg":"using ACME account","account_id":"https://acme.zerossl.com/v2/DV90/account/5JCbkwUbAVTwtJg99maMoQ","account_contact":["mailto:[email protected]"]}

{"level":"info","ts":1738874146.702428,"logger":"tls.issuance.acme","msg":"waiting on internal rate limiter","identifiers":["vault.obelix.cloud"],"ca":"https://acme.zerossl.com/v2/DV90","account":"[email protected]"}

{"level":"info","ts":1738874146.7049432,"logger":"tls.issuance.acme","msg":"done waiting on internal rate limiter","identifiers":["vault.obelix.cloud"],"ca":"https://acme.zerossl.com/v2/DV90","account":"[email protected]"}

{"level":"info","ts":1738874146.7049727,"logger":"tls.issuance.acme","msg":"using ACME account","account_id":"https://acme.zerossl.com/v2/DV90/account/gqzVDAfQAL5fSTT_wGJmpg","account_contact":["mailto:[email protected]"]}

{"level":"info","ts":1738874147.0323133,"logger":"tls.issuance.acme.acme_client","msg":"trying to solve challenge","identifier":"office.obelix.cloud","challenge_type":"http-01","ca":"https://acme.zerossl.com/v2/DV90"}

{"level":"info","ts":1738874151.3564546,"logger":"tls.issuance.acme.acme_client","msg":"trying to solve challenge","identifier":"vault.obelix.cloud","challenge_type":"http-01","ca":"https://acme.zerossl.com/v2/DV90"}

{"level":"info","ts":1738874168.7067974,"logger":"docker-proxy","msg":"New Caddyfile","caddyfile":"{\n\temail [email protected]\n}\ndrive.obelix.cloud {\n\tencode gzip\n\tfile_server\n\theader {\n\t\tStrict-Transport-Security max-age=15768000;\n\t\tX-Content-Type-Options nosniff\n\t\tX-Frame-Options SAMEORIGIN\n\t\tX-XSS-Protection \"1; mode=block;\"\n\t}\n\treverse_proxy 10.89.0.225:80 {\n\t\theader_up Host drive.obelix.cloud\n\t}\n}\nhttp://bazarr.o {\n\treverse_proxy 10.89.0.104:6767\n}\nhttp://jellyfin.o {\n\treverse_proxy 10.89.0.85:8096\n}\nhttp://lidarr.o {\n\treverse_proxy 10.89.0.96:8686\n}\nhttp://radarr.o {\n\treverse_proxy 10.89.0.93:7878\n}\nhttp://solverr.o {\n\treverse_proxy 10.89.0.87:8191\n}\nhttp://sonarr.o {\n\treverse_proxy 10.89.0.90:8989\n}\nhttp://torrents.o {\n\treverse_proxy 10.89.0.86:9696\n}\noffice.obelix.cloud {\n\tencode gzip\n\treverse_proxy 10.89.0.99:80\n}\nvault.obelix.cloud {\n\tencode gzip\n\theader {\n\t\tX-Content-Type-Options none\n\t\tX-Frame-Options DENY\n\t\tX-XSS-Protection \"1; mode=block;\"\n\t}\n\treverse_proxy /notifications/hub 10.89.0.84:3012\n\treverse_proxy /notifications/hub/negotiate 10.89.0.84:80\n\treverse_proxy 10.89.0.84:80\n}\n"}

{"level":"info","ts":1738874168.7085369,"logger":"docker-proxy","msg":"New Config JSON","json":"{\"apps\":{\"http\":{\"servers\":{\"srv0\":{\"listen\":[\":443\"],\"routes\":[{\"match\":[{\"host\":[\"office.obelix.cloud\"]}],\"handle\":[{\"handler\":\"subroute\",\"routes\":[{\"handle\":[{\"encodings\":{\"gzip\":{}},\"handler\":\"encode\",\"prefer\":[\"gzip\"]},{\"handler\":\"reverse_proxy\",\"upstreams\":[{\"dial\":\"10.89.0.99:80\"}]}]}]}],\"terminal\":true},{\"match\":[{\"host\":[\"drive.obelix.cloud\"]}],\"handle\":[{\"handler\":\"subroute\",\"routes\":[{\"handle\":[{\"handler\":\"headers\",\"response\":{\"set\":{\"Strict-Transport-Security\":[\"max-age=15768000;\"],\"X-Content-Type-Options\":[\"nosniff\"],\"X-Frame-Options\":[\"SAMEORIGIN\"],\"X-Xss-Protection\":[\"1; mode=block;\"]}}},{\"encodings\":{\"gzip\":{}},\"handler\":\"encode\",\"prefer\":[\"gzip\"]},{\"handler\":\"reverse_proxy\",\"headers\":{\"request\":{\"set\":{\"Host\":[\"drive.obelix.cloud\"]}}},\"upstreams\":[{\"dial\":\"10.89.0.225:80\"}]},{\"handler\":\"file_server\",\"hide\":[\"./Caddyfile\"]}]}]}],\"terminal\":true},{\"match\":[{\"host\":[\"vault.obelix.cloud\"]}],\"handle\":[{\"handler\":\"subroute\",\"routes\":[{\"handle\":[{\"handler\":\"headers\",\"response\":{\"set\":{\"X-Content-Type-Options\":[\"none\"],\"X-Frame-Options\":[\"DENY\"],\"X-Xss-Protection\":[\"1; mode=block;\"]}}},{\"encodings\":{\"gzip\":{}},\"handler\":\"encode\",\"prefer\":[\"gzip\"]}]},{\"handle\":[{\"handler\":\"reverse_proxy\",\"upstreams\":[{\"dial\":\"10.89.0.84:80\"}]}],\"match\":[{\"path\":[\"/notifications/hu
ate\"]}]},{\"handle\":[{\"handler\":\"reverse_proxy\",\"upstreams\":[{\"dial\":\"10.89.0.84:3012\"}]}],\"match\":[{\"path\":[\"/notifications/hub\"]}]},{\"handle\":[{\"handler\":\"reverse_proxy\",\"upstreams\":[{\"dial\":\"10.89.0.84:80\"}]}]}]}],\"terminal\":true}]},\"srv1\":{\"listen\":[\":80\"],\"routes\":[{\"match\":[{\"host\":[\"jellyfin.o\"]}],\"handle\":[{\"handler\":\"subroute\",\"routes\":[{\"handle\":[{\"handler\":\"reverse_proxy
treams\":[{\"dial\":\"10.89.0.85:8096\"}]}]}]}],\"terminal\":true},{\"match\":[{\"host\":[\"torrents.o\"]}],\"handle\":[{\"handler\":\"subroute\",\"routes\":[{\"handle\":[{\"handler\":\"reverse_proxy\",\"upstreams\":[{\"dial\":\"10.89.0.86:9696\"}]}]}]}],\"terminal\":true},{\"match\":[{\"host\":[\"solverr.o\"]}],\"handle\":[{\"handler\":\"subroute\",\"routes\":[{\"handle\":[{\"handler\":\"reverse_proxy\",\"upstreams\":[{\"dial\":\"10.89.0.87:8191\"}]}]}]}],\"terminal\":true},{\"match\":[{\"host\":[\"bazarr.o\"]}],\"handle\":[{\"handler\":\"subroute\",\"routes\":[{\"handle\":[{\"handler\":\"reverse_proxy\",\"upstreams\":[{\"dial\":\"10.89.0.104:6767\"}]}]}]}],\"terminal\":true},{\"match\":[{\"host\":[\"lidarr.o\"]}],\"handle\":[{\"handler\":\"subroute\",\"routes\":[{\"handle\":[{\"handler\":\"reverse_proxy\",\"upstreams\":[{\"dial\":\"10.89.0.96:8686\"}]}]}]}],\"terminal\":true},{\"match\":[{\"host\":[\"radarr.o\"]}],\"handle\":[{\"handler\":\"subroute\",\"routes\":[{\"handle\":[{\"handler\":\"reverse_proxy\",\"upstreams\":[{\"dial\":\"10.89.0.93:7878\"}]}]}]}],\"terminal\":true},{\"match\":[{\"host\":[\"sonarr.o\"]}],\"handle\":[{\"handler\":\"subroute\",\"routes\":[{\"handle\":[{\"handler\":\"reverse_proxy\",\"upstreams\":[{\"dial\":\"10.89.0.90:8989\"}]}]}]}],\"terminal\":true}]}}},\"tls\":{\"automation\":{\"policies\":[{\"subjects\":[\"office.obelix.cloud\",\"drive.obelix.cloud\",\"vault.obelix.cloud\"],\"issuers\":[{\"email\":\"[email protected]\",\"module\":\"acme\"},{\"ca\":\"https://acme.zerossl.com/v2/DV90\",\"email\":\"[email protected]\",\"module\":\"acme\"}]}]}}}}"}

{"level":"info","ts":1738874168.7087858,"logger":"docker-proxy","msg":"Sending configuration to","server":"localhost"}

{"level":"info","ts":1738874168.709751,"logger":"admin.api","msg":"received request","method":"POST","host":"localhost:2019","uri":"/load","remote_ip":"127.0.0.1","remote_port":"51892","headers":{"Accept-Encoding":["gzip"],"Content-Length":["3123"],"Content-Type":["application/json"],"User-Agent":["Go-http-client/1.1"]}}

{"level":"info","ts":1738874168.7110586,"logger":"admin","msg":"admin endpoint started","address":"localhost:2019","enforce_origin":false,"origins":["//localhost:2019","//[::1]:2019","//127.0.0.1:2019"]}

{"level":"info","ts":1738874168.711495,"logger":"http.auto_https","msg":"server is listening only on the HTTPS port but has no TLS connection policies; adding one to enable TLS","server_name":"srv0","https_port":443}

{"level":"info","ts":1738874168.7116132,"logger":"http.auto_https","msg":"enabling automatic HTTP->HTTPS redirects","server_name":"srv0"}

{"level":"warn","ts":1738874168.7117097,"logger":"http.auto_https","msg":"server is listening only on the HTTP port, so no automatic HTTPS will be applied to this server","server_name":"srv1","http_port":80}

{"level":"info","ts":1738874168.712454,"logger":"http","msg":"enabling HTTP/3 listener","addr":":443"}

{"level":"info","ts":1738874168.7126336,"logger":"http.log","msg":"server running","name":"srv0","protocols":["h1","h2","h3"]}

{"level":"info","ts":1738874168.7126713,"logger":"http.log","msg":"server running","name":"srv1","protocols":["h1","h2","h3"]}

{"level":"info","ts":1738874168.7126744,"logger":"http","msg":"enabling automatic TLS certificate management","domains":["office.obelix.cloud","drive.obelix.cloud","vault.obelix.cloud"]}

{"level":"info","ts":1738874168.7127793,"logger":"http","msg":"servers shutting down with eternal grace period"}

{"level":"info","ts":1738874168.7130332,"logger":"tls.obtain","msg":"acquiring lock","identifier":"office.obelix.cloud"}

{"level":"info","ts":1738874168.7132168,"logger":"tls.obtain","msg":"acquiring lock","identifier":"drive.obelix.cloud"}

{"level":"info","ts":1738874168.7148147,"logger":"tls.obtain","msg":"acquiring lock","identifier":"vault.obelix.cloud"}

{"level":"warn","ts":1738874168.7159266,"logger":"tls.issuance.acme.acme_client","msg":"HTTP request failed; retrying","url":"https://acme.zerossl.com/v2/DV90/authz/k8lSVg5kws1mo9xXRe4VcQ","error":"performing request: Post \"https://acme.zerossl.com/v2/DV90/authz/k8lSVg5kws1mo9xXRe4VcQ\": context canceled"}

{"level":"error","ts":1738874168.716111,"logger":"tls.issuance.acme.acme_client","msg":"deactivating authorization","identifier":"vault.obelix.cloud","authz":"https://acme.zerossl.com/v2/DV90/authz/k8lSVg5kws1mo9xXRe4VcQ","error":"attempt 1: https://acme.zerossl.com/v2/DV90/authz/k8lSVg5kws1mo9xXRe4VcQ: context canceled"}

{"level":"error","ts":1738874168.7162092,"logger":"tls.obtain","msg":"could not get certificate from issuer","identifier":"vault.obelix.cloud","issuer":"acme.zerossl.com-v2-DV90","error":"[vault.obelix.cloud] solving challenges: [vault.obelix.cloud] context canceled (order=https://acme.zerossl.com/v2/DV90/order/C--zwAIjxTiv8R-L3dQl4g) (ca=https://acme.zerossl.com/v2/DV90)"}

{"level":"info","ts":1738874168.7162466,"logger":"tls.obtain","msg":"releasing lock","identifier":"vault.obelix.cloud"}

{"level":"error","ts":1738874168.7163994,"logger":"tls","msg":"job failed","error":"vault.obelix.cloud: obtaining certificate: [vault.obelix.cloud] Obtain: [vault.obelix.cloud] solving challenges: [vault.obelix.cloud] context canceled (order=https://acme.zerossl.com/v2/DV90/order/C--zwAIjxTiv8R-L3dQl4g) (ca=https://acme.zerossl.com/v2/DV90)"}

{"level":"info","ts":1738874168.7167122,"msg":"autosaved config (load with --resume flag)","file":"/config/caddy/autosave.json"}

{"level":"info","ts":1738874168.7167194,"logger":"admin.api","msg":"load complete"}

{"level":"info","ts":1738874168.716803,"logger":"docker-proxy","msg":"Successfully configured","server":"localhost"}

{"level":"warn","ts":1738874168.7170107,"logger":"tls.issuance.acme.acme_client","msg":"HTTP request failed; retrying","url":"https://acme.zerossl.com/v2/DV90/authz/-TEgtfgR9vVsA0hHxMHseQ","error":"performing request: Post \"https://acme.zerossl.com/v2/DV90/authz/-TEgtfgR9vVsA0hHxMHseQ\": context canceled"}

{"level":"error","ts":1738874168.7170222,"logger":"tls.issuance.acme.acme_client","msg":"deactivating authorization","identifier":"office.obelix.cloud","authz":"https://acme.zerossl.com/v2/DV90/authz/-TEgtfgR9vVsA0hHxMHseQ","error":"attempt 1: https://acme.zerossl.com/v2/DV90/authz/-TEgtfgR9vVsA0hHxMHseQ: context canceled"}

{"level":"error","ts":1738874168.7170331,"logger":"tls.obtain","msg":"could not get certificate from issuer","identifier":"office.obelix.cloud","issuer":"acme.zerossl.com-v2-DV90","error":"[office.obelix.cloud] solving challenges: [office.obelix.cloud] context canceled (order=https://acme.zerossl.com/v2/DV90/order/UJmzBwGnxt8AGXHwhp-9IQ) (ca=https://acme.zerossl.com/v2/DV90)"}

{"level":"info","ts":1738874168.7170534,"logger":"tls.obtain","msg":"releasing lock","identifier":"office.obelix.cloud"}

{"level":"error","ts":1738874168.7171063,"logger":"tls","msg":"job failed","error":"office.obelix.cloud: obtaining certificate: [office.obelix.cloud] Obtain: [office.obelix.cloud] solving challenges: [office.obelix.cloud] context canceled (order=https://acme.zerossl.com/v2/DV90/order/UJmzBwGnxt8AGXHwhp-9IQ) (ca=https://acme.zerossl.com/v2/DV90)"}

{"level":"info","ts":1738874168.7187626,"logger":"tls.obtain","msg":"lock acquired","identifier":"drive.obelix.cloud"}

{"level":"info","ts":1738874168.718882,"logger":"admin","msg":"stopped previous server","address":"localhost:2019"}

{"level":"info","ts":1738874168.7189748,"logger":"tls.obtain","msg":"obtaining certificate","identifier":"drive.obelix.cloud"}

{"level":"info","ts":1738874168.7192743,"logger":"tls.issuance.acme","msg":"waiting on internal rate limiter","identifiers":["drive.obelix.cloud"],"ca":"https://acme-v02.api.letsencrypt.org/directory","account":"[email protected]"}


":"info","ts":1738874168.7197049,"logger":"tls.issuance.acme","msg":"done waiting on internal rate limiter","identifiers":["drive.obelix.cloud"],"ca":"https://acme-v02.api.letsencrypt.org/directory","account":"[email protected]"}

{"level":"info","ts":1738874168.7197225,"logger":"tls.issuance.acme","msg":"using ACME account","account_id":"https://acme-v02.api.letsencrypt.org/acme/acct/2213713405","account_contact":["mailto:[email protected]"]}

{"level":"info","ts":1738874168.771278,"logger":"docker-proxy","msg":"New Caddyfile","caddyfile":"{\n\temail [email protected]\n}\nhttp://bazarr.o {\n\treverse_proxy 10.89.0.104:6767\n}\nhttp://jellyfin.o {\n\treverse_proxy 10.89.0.85:8096\n}\nhttp://lidarr.o {\n\treverse_proxy 10.89.0.96:8686\n}\nhttp://radarr.o {\n\treverse_proxy 10.89.0.93:7878\n}\nhttp://solverr.o {\n\treverse_proxy 10.89.0.87:8191\n}\nhttp://sonarr.o {\n\treverse_proxy 10.89.0.90:8989\n}\nhttp://torrents.o {\n\treverse_proxy 10.89.0.86:9696\n}\noffice.obelix.cloud {\n\tencode gzip\n\treverse_proxy 10.89.0.99:80\n}\nvault.obelix.cloud {\n\tencode gzip\n\theader {\n\t\tX-Content-Type-Options none\n\t\tX-Frame-Options DENY\n\t\tX-XSS-Protection \"1; mode=block;\"\n\t}\n\treverse_proxy /notifications/hub 10.89.0.84:3012\n\treverse_proxy /notifications/hub/negotiate 10.89.0.84:80\n\treverse_proxy 10.89.0.84:80\n}\n"}

{"level":"info","ts":1738874168.7734706,"logger":"docker-proxy","msg":"New Config JSON","json":"{\"apps\":{\"http\":{\"servers\":{\"srv0\":{\"listen\":[\":443\"],\"routes\":[{\"match\":[{\"host\":[\"office.obelix.cloud\"]}],\"handle\":[{\"handler\":\"subroute\",\"routes\":[{\"handle\":[{\"encodings\":{\"gzip\":{}},\"handler\":\"encode\",\"prefer\":[\"gzip\"]},{\"handler\":\"reverse_proxy\",\"upstreams\":[{\"dial\":\"10.89.0.99:80\"}]}]}]}],\"terminal\":true},{\"match\":[{\"host\":[\"vault.obelix.cloud\"]}],\"handle\":[{\"handler\":\"subroute\",\"routes\":[{\"handle\":[{\"handler\":\"headers\",\"response\":{\"set\":{\"X-Content-Type-Options\":[\"none\"],\"X-Frame-Options\":[\"DENY\"],\"X-Xss-Protection\":[\"1; mode=block;\"]}}},{\"encodings\":{\"gzip\":{}},\"handler\":\"encode\",\"prefer\":[\"gzip\"]}]},{\"handle\":[{\"handler\":\"reverse_proxy\",\"upstreams\":[{\"dial\":\"10.89.0.84:80\"}]}],\"match\":[{\"path\":[\"/notifications/hub/negotiate\"]}]},{\"handle\":[{\"handler\":\"reverse_proxy\",\"upstreams\":[{\"dial\":\"10.89.0.84:3012\"}]}],\"match\":[{\"path\":[\"/notifications/hub\"]}]},{\"handle\":[{\"handler\":\"reverse_proxy\",\"upstreams\":[{\"dial\":\"10.89.0.84:80\"}]}]}]}],\"terminal\":true}]},\"srv1\":{\"listen\":[\":80\"],\"routes\":[{\"match\":[{\"host\":[\"jellyfin.o\"]}],\"handle\":[{\"handler\":\"subroute\",\"routes\":[{\"handle\":[{\"handler\":\"reverse_proxy\",\"upstreams\":[{\"dial\":\"10.89.0.85:8096\"}]}]}]}],\"terminal\":true},{\"match\":[{\"host\":[\"torrents.o\"]}],\"handle\":[{\"handler\":\"subroute\",\"routes\":[{\"handle\":[{\"handler\":\"reverse_proxy\",\"upstreams\":[{\"dial\":\"10.89.0.86:9696\"}]}]}]}],\"terminal\":true},{\"match\":[{\"host\":[\"solverr.o\"]}],\"handle\":[{\"handler\":\"subroute\",\"routes\":[{\"handle\":[{\"handler\":\"reverse_proxy\",\"upstreams\":[{\"dial\":\"10.89.0.87:8191\"}]}]}]}],\"terminal\":true},{\"match\":[{\"host\":[\"bazarr.o\"]}],\"handle\":[{\"handler\":\"subroute\",\"routes\":[{\"handle\":[{\"handler\":\"reverse_proxy\",\"upstreams\":[{\"dial
89.0.104:6767\"}]}]}]}],\"terminal\":true},{\"match\":[{\"host\":[\"lidarr.o\"]}],\"handle\":[{\"handler\":\"subroute\",\"routes\":[{\"handle\":[{\"handler\":\"reverse_proxy\",\"upstreams\":[{\"dial\":\"10.89.0.96:8686\"}]}]}]}],\"terminal\":true},{\"match\":[{\"host\":[\"radarr.o\"]}],\"handle\":[{\"handler\":\"subroute\",\"routes\":[{\"handle\":[{\"handler\":\"reverse_proxy\",\"upstreams\":[{\"dial\":\"10.89.0.93:7878\"}]}]}]}],\"terminal\":true},{\"match\":[{\"host\":[\"sonarr.o\"]}],\"handle\":[{\"handler\":\"subroute\",\"routes\":[{\"handle\":[{\"handler\":\"reverse_proxy\",\"upstreams\":[{\"dial\":\"10.89.0.90:8989\"}]}]}]}],\"terminal\":true}]}}},\"tls\":{\"automation\":{\"policies\":[{\"subjects\":[\"office.obelix.cloud\",\"vault.obelix.cloud\"],\"issuers\":[{\"email\":\"[email protected]\",\"module\":\"acme\"},{\"ca\":\"https://acme.zerossl.com/v2/DV90\",\"email\":\"[email protected]\",\"module\":\"acme\"}]}]}}}}"}

{"level":"info","ts":1738874168.7735932,"logger":"docker-proxy","msg":"Sending configuration to","server":"localhost"}

{"level":"info","ts":1738874168.7741148,"logger":"admin.api","msg":"received request","method":"POST","host":"localhost:2019","uri":"/load","remote_ip":"127.0.0.1","remote_port":"51898","headers":{"Accept-Encoding":["gzip"],"Content-Length":["2541"],"Content-Type":["application/json"],"User-Agent":["Go-http-client/1.1"]}}

{"level":"info","ts":1738874168.7746897,"logger":"admin","msg":"admin endpoint started","address":"localhost:2019","enforce_origin":false,"origins":["//localhost:2019","//[::1]:2019","//127.0.0.1:2019"]}

{"level":"info","ts":1738874168.774817,"logger":"http.auto_https","msg":"server is listening only on the HTTPS port but has no TLS connection policies; adding one to enable TLS","server_name":"srv0","https_port":443}

{"level":"info","ts":1738874168.7748282,"logger":"http.auto_https","msg":"enabling automatic HTTP->HTTPS redirects","server_name":"srv0"}

{"level":"warn","ts":1738874168.7748506,"logger":"http.auto_https","msg":"server is listening only on the HTTP port, so no automatic HTTPS will be applied to this server","server_name":"srv1","http_port":80}

{"level":"info","ts":1738874168.7752295,"logger":"http","msg":"enabling HTTP/3 listener","addr":":443"}

{"level":"info","ts":1738874168.7752435,"logger":"http.log","msg":"server running","name":"srv0","protocols":["h1","h2","h3"]}

{"level":"info","ts":1738874168.775267,"logger":"http.log","msg":"server running","name":"srv1","protocols":["h1","h2","h3"]}

{"level":"info","ts":1738874168.775272,"logger":"http","msg":"enabling automatic TLS certificate management","domains":["vault.obelix.cloud","office.obelix.cloud"]}

{"level":"info","ts":1738874168.775341,"logger":"http","msg":"servers shutting down with eternal grace period"}

{"level":"info","ts":1738874168.7756217,"logger":"tls.obtain","msg":"acquiring lock","identifier":"vault.obelix.cloud"}

{"level":"info","ts":1738874168.7759025,"logger":"tls.obtain","msg":"acquiring lock","identifier":"office.obelix.cloud"}

{"level":"info","ts":1738874168.7759924,"msg":"autosaved config (load with --resume flag)","file":"/config/caddy/autosave.json"}

{"level":"info","ts":1738874168.7760017,"logger":"admin.api","msg":"load complete"}

{"level":"error","ts":1738874168.776076,"logger":"tls","msg":"job failed","error":"vault.obelix.cloud: obtaining certificate: unable to acquire lock 'issue_cert_vault.obelix.cloud': context canceled"}

{"level":"error","ts":1738874168.7760847,"logger":"tls","msg":"job failed","error":"office.obelix.cloud: obtaining certificate: unable to acquire lock 'issue_cert_office.obelix.cloud': context canceled"}

{"level":"warn","ts":1738874168.7761035,"logger":"tls.issuance.acme.acme_client","msg":"HTTP request failed; retrying","url":"https://acme-v02.api.letsencrypt.org/acme/new-nonce","error":"performing request: Head \"https://acme-v02.api.letsencrypt.org/acme/new-nonce\": context canceled"}

{"level":"error","ts":1738874168.77612,"logger":"tls.obtain","msg":"could not get certificate from issuer","identifier":"drive.obelix.cloud","issuer":"acme-v02.api.letsencrypt.org-directory","error":"[drive.obelix.cloud] creating new order: fetching new nonce from server: context canceled (ca=https://acme-v02.api.letsencrypt.org/directory)"}

{"level":"info","ts":1738874168.7762706,"logger":"tls.issuance.acme","msg":"waiting on internal rate limiter","identifiers":["drive.obelix.cloud"],"ca":"https://acme.zerossl.com/v2/DV90","account":"[email protected]"}

{"level":"info","ts":1738874168.776276,"logger":"tls.issuance.acme","msg":"done waiting on internal rate limiter","identifiers":["drive.obelix.cloud"],"ca":"https://acme.zerossl.co
0","account":"[email protected]"}

{"level":"info","ts":1738874168.7762823,"logger":"tls.issuance.acme","msg":"using ACME account","account_id":"https://acme.zerossl.com/v2/DV90/account/gqzVDAfQAL5fSTT_wGJmpg","account_contact":["mailto:[email protected]"]}

{"level":"warn","ts":1738874168.7763052,"logger":"tls.issuance.acme.acme_client","msg":"HTTP request failed; retrying","url":"https://acme.zerossl.com/v2/DV90/newNonce","error":"performing request: Head \"https://acme.zerossl.com/v2/DV90/newNonce\": context canceled"}

{"level":"error","ts":1738874168.7763133,"logger":"tls.obtain","msg":"could not get certificate from issuer","identifier":"drive.obelix.cloud","issuer":"acme.zerossl.com-v2-DV90","error":"[drive.obelix.cloud] creating new order: fetching new nonce from server: context canceled (ca=https://acme.zerossl.com/v2/DV90)"}

{"level":"info","ts":1738874168.7763348,"logger":"tls.obtain","msg":"releasing lock","identifier":"drive.obelix.cloud"}

{"level":"error","ts":1738874168.7763982,"logger":"tls","msg":"job failed","error":"drive.obelix.cloud: obtaining certificate: [drive.obelix.cloud] Obtain: [drive.obelix.cloud] creating new order: fetching new nonce from server: context canceled (ca=https://acme.zerossl.com/v2/DV90)"}

{"level":"info","ts":1738874168.7764266,"logger":"docker-proxy","msg":"Successfully configured","server":"localhost"}

{"level":"info","ts":1738874168.776647,"logger":"admin","msg":"stopped previous server","address":"localhost:2019"}

{"level":"info","ts":1738874168.779233,"logger":"tls.obtain","msg":"lock acquired","identifier":"office.obelix.cloud"}

{"level":"info","ts":1738874168.7795265,"logger":"tls.obtain","msg":"obtaining certificate","identifier":"office.obelix.cloud"}

{"level":"info","ts":1738874168.7802691,"logger":"tls.issuance.acme","msg":"waiting on internal rate limiter","identifiers":["office.obelix.cloud"],"ca":"https://acme-v02.api.letsencrypt.org/directory","account":"[email protected]"}

{"level":"info","ts":1738874168.7802913,"logger":"tls.issuance.acme","msg":"done waiting on internal rate limiter","identifiers":["office.obelix.cloud"],"ca":"https://acme-v02.api.letsencrypt.org/directory","account":"[email protected]"}

{"level":"info","ts":1738874168.7802994,"logger":"tls.issuance.acme","msg":"using ACME account","account_id":"https://acme-v02.api.letsencrypt.org/acme/acct/2213713405","account_contact":["mailto:[email protected]"]}

{"level":"info","ts":1738874168.782661,"logger":"tls.obtain","msg":"lock acquired","identifier":"vault.obelix.cloud"}

{"level":"info","ts":1738874168.7830155,"logger":"tls.obtain","msg":"obtaining certificate","identifier":"vault.obelix.cloud"}

{"level":"info","ts":1738874168.7833865,"logger":"tls.issuance.acme","msg":"waiting on internal rate limiter","identifiers":["vault.obelix.cloud"],"ca":"https://acme-v02.api.letsencrypt.org/directory","account":"[email protected]"}

{"level":"info","ts":1738874168.7834046,"logger":"tls.issuance.acme","msg":"done waiting on internal rate limiter","identifiers":["vault.obelix.cloud"],"ca":"https://acme-v02.api.letsencrypt.org/directory","account":"[email protected]"}

{"level":"info","ts":1738874168.783412,"logger":"tls.issuance.acme","msg":"using ACME account","account_id":"https://acme-v02.api.letsencrypt.org/acme/acct/2213713405","account_contact":["mailto:[email protected]"]}

{"level":"error","ts":1738874169.3569188,"logger":"tls.obtain","msg":"could not get certificate from issuer","identifier":"vault.obelix.cloud","issuer":"acme-v02.api.letsencrypt.org-directory","error":"HTTP 429 urn:ietf:params:acme:error:rateLimited - too many failed authorizations (5) for \"vault.obelix.cloud\" in the last 1h0m0s, retry after 2025-02-06 20:47:28 UTC: see https://letsencrypt.org/docs/rate-limits/#authorization-failures-per-hostname-per-account"}

{"level":"info","ts":1738874169.35708,"logger":"tls.issuance.acme","msg":"waiting on internal rate limiter","identifiers":["vault.obelix.cloud"],"ca":"https://acme.zerossl.com/v2/DV90","account":"[email protected]"}

{"level":"info","ts":1738874169.3570929,"logger":"tls.issuance.acme","msg":"done waiting on internal rate limiter","identifiers":["vault.obelix.cloud"],"ca":"https://acme.zerossl.com/v2/DV90","account":"[email protected]"}

{"level":"info","ts":1738874169.3571007,"logger":"tls.issuance.acme","msg":"using ACME account","account_id":"https://acme.zerossl.com/v2/DV90/account/gqzVDAfQAL5fSTT_wGJmpg","account_contact":["mailto:[email protected]"]}

{"level":"info","ts":1738874169.555623,"logger":"tls.issuance.acme.acme_client","msg":"trying to solve challenge","identifier":"office.obelix.cloud","challenge_type":"tls-alpn-01","ca":"https://acme-v02.api.letsencrypt.org/directory"}

{"level":"error","ts":1738874170.482515,"logger":"tls.issuance.acme.acme_client","msg":"challenge failed","identifier":"office.obelix.cloud","challenge_type":"tls-alpn-01","problem":{"type":"urn:ietf:params:acme:error:connection","title":"","detail":"86.93.76.50: Error getting validation data","instance":"","subproblems":[]}}

{"level":"error","ts":1738874170.482794,"logger":"tls.issuance.acme.acme_client","msg":"validating authorization","identifier":"office.obelix.cloud","problem":{"type":"urn:ietf:params:acme:error:connection","title":"","detail":"86.93.76.50: Error getting validation data","instance":"","subproblems":[]},"order":"https://acme-v02.api.letsencrypt.org/acme/order/2213713405/351852264385","attempt":1,"max_attempts":3}

{"level":"info","ts":1738874171.8125026,"logger":"tls.issuance.acme.acme_client","msg":"trying to solve challenge","identifier":"office.obelix.cloud","challenge_type":"http-01","ca":"https://acme-v02.api.letsencrypt.org/directory"}

{"level":"error","ts":1738874172.914878,"logger":"tls.issuance.acme.acme_client","msg":"challenge failed","identifier":"office.obelix.cloud","challenge_type":"http-01","problem":{"type":"urn:ietf:params:acme:error:connection","title":"","detail":"86.93.76.50: Fetching http://office.obelix.cloud/.well-known/acme-challenge/fpViAjxeQXkRKXwrb8-7SJ3EFXxRu6BGc92k0vLJTzA: Error getting validation data","instance":"","subproblems":[]}}

{"level":"error","ts":1738874172.9151902,"logger":"tls.issuance.acme.acme_client","msg":"validating authorization","identifier":"office.obelix.cloud","problem":{"type":"urn:ietf:params:acme:error:connection","title":"","detail":"86.93.76.50: Fetching http://office.obelix.cloud/.well-known/acme-challenge/fpViAjxeQXkRKXwrb8-7SJ3EFXxRu6BGc92k0vLJTzA: Error getting validation data","instance":"","subproblems":[]},"order":"https://acme-v02.api.letsencrypt.org/acme/order/2213713405/351852272035","attempt":2,"max_attempts":3}

{"level":"error","ts":1738874172.9152083,"logger":"tls.obtain","msg":"could not get certificate from issuer","identifier":"office.obelix.cloud","issuer":"acme-v02.api.letsencrypt.org-directory","error":"HTTP 400 urn:ietf:params:acme:error:connection - 86.93.76.50: Fetching http://office.obelix.cloud/.well-known/acme-challenge/fpViAjxeQXkRKXwrb8-7SJ3EFXxRu6BGc92k0vLJTzA: Error getting validation data"}

{"level":"info","ts":1738874172.9153767,"logger":"tls.issuance.acme","msg":"waiting on internal rate limiter","identifiers":["office.obelix.cloud"],"ca":"https://acme.zerossl.com/v2/DV90","account":"[email protected]"}

{"level":"info","ts":1738874172.9153929,"logger":"tls.issuance.acme","msg":"done waiting on internal rate limiter","identifiers":["office.obelix.cloud"],"ca":"https://acme.zerossl.com/v2/DV90","account":"[email protected]"}

{"level":"info","ts":1738874172.9154017,"logger":"tls.issuance.acme","msg":"using ACME account","account_id":"https://acme.zerossl.com/v2/DV90/account/gqzVDAfQAL5fSTT_wGJmpg","account_contact":["mailto:[email protected]"]}

{"level":"info","ts":17388
13332,"logger":"tls.issuance.acme.acme_client","msg":"trying to solve challenge","identifier":"vault.obelix.cloud","challenge_type":"http-01","ca":"https://acme.zerossl.com/v2/DV90"}

{"level":"info","ts":1738874177.4295335,"logger":"tls.issuance.acme.acme_client","msg":"trying to solve challenge","identifier":"office.obelix.cloud","challenge_type":"http-01","ca":"https://acme.zerossl.com/v2/DV90"}

Feb 06 '25 20:02 zilexa