Strange behavior with cert-manager/acme-dns

[okorsky]

Acme2certifier is such a great solution. Thank you so much for your efforts and for actively maintaining it.

I'm running through a very strange behavior with cert-manager and acme-dns setup.

cert-manager creates the account on acme2certifier, it registers account on acme-dns, it requests a certificate and then creates the TXT records on acme-dns, the CNAME is created on the primary DNS.

However, after cert-manager validates the presence of the TXT records, and when it tries to pull the certificate/order status of acme2certifier, acme2certifier keeps responding with "processing". It keeps doing that forever (so far 24h+).

doing dig from acme2certifier server and any other host within the network shows the existence of the TXT and CNAME records.

meanwhile, no DNS traffic is seen from acme2certifier during those 24+ hours.

logs and dig response below.

note: there's no issue whatsoever with acme.sh, certbot or winacme, all work perfectly in the same enviorment.

[Fri Apr 05 22:54:00.072174 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] _config_load() [Fri Apr 05 22:54:00.073504 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] Authorization._config_load() [Fri Apr 05 22:54:00.074245 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] Authorization._config_load() ended. [Fri Apr 05 22:54:00.074337 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] Authorization.new_post() [Fri Apr 05 22:54:00.074402 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] Authorization.invalidate(None) [Fri Apr 05 22:54:00.074479 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] Authorization.invalidate(): set timestamp to 1712357640 [Fri Apr 05 22:54:00.074532 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] DBStore.authorizations_expired_search(column:expires, pattern:1712357640) [Fri Apr 05 22:54:00.075213 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] DBStore.authorizations_expired_search-() ended [Fri Apr 05 22:54:00.075283 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] Authorization.invalidate() ended: 0 authorizations identified [Fri Apr 05 22:54:00.075327 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] Message.check() [Fri Apr 05 22:54:00.075379 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] decode_message() [Fri Apr 05 22:54:00.075658 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] Message._check() [Fri Apr 05 22:54:00.075713 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] Nonce.check_nonce() [Fri Apr 05 22:54:00.075766 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] Nonce.nonce._check_and_delete(86bd8003153e4a759716f760bbe5eda8) [Fri Apr 05 22:54:00.075815 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] DBStore.nonce_check(86bd8003153e4a759716f760bbe5eda8) [Fri Apr 05 22:54:00.076307 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] DBStore.nonce_check() ended [Fri Apr 05 22:54:00.076387 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] DBStore.nonce_delete(86bd8003153e4a759716f760bbe5eda8) [Fri Apr 05 22:54:00.090649 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] DBStore.nonce_delete() ended [Fri Apr 05 22:54:00.090761 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] Nonce._check_and_delete() ended with:200 [Fri Apr 05 22:54:00.090806 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] Nonce.check_nonce() ended with:200 [Fri Apr 05 22:54:00.090845 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] Message._name_get() [Fri Apr 05 22:54:00.090923 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] kid: https://acmeserver01.acmelab.sec.internal/acme/acct/D9NNGvob2I4F [Fri Apr 05 22:54:00.090975 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] Message._name_get() returns: D9NNGvob2I4F [Fri Apr 05 22:54:00.091531 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] error_dict_get() [Fri Apr 05 22:54:00.092039 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] Signature.check(D9NNGvob2I4F) [Fri Apr 05 22:54:00.092137 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] check signature against account key [Fri Apr 05 22:54:00.092193 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] Signature._jwk_load(D9NNGvob2I4F) [Fri Apr 05 22:54:00.092259 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] DBStore.jwk_load(D9NNGvob2I4F) [Fri Apr 05 22:54:00.092307 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] DBStore._account_search(column:name, pattern:D9NNGvob2I4F) [Fri Apr 05 22:54:00.092821 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] DBStore._account_search() ended with: True [Fri Apr 05 22:54:00.092939 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] DBStore.jwk_load() ended with: {'e': 'AQAB', 'kty': 'RSA', 'n': 'ps9K-qylieUk6XUPWPAnmykVLt5tWYFT418hIqz4okLXE-89a3zHIFJm_Taqyr_4eiSd5lNXv2kTuLmqTgxH55MvuIllRwrHeu9S2V9nJq5B_v3wduGZCe_HvuspqzW5fGj1n6P6iVrO0cyujIAiJD-4Q94jGTIXfn7CKKN31aG1dj3mU1r32KnRDuvanefV15lLbhxqbnXgtPAd4sArTMKJx5ijW5YqLXiMSGNMu5y7A9IJEvIxhE_GL4cPq9EiKvIK-f7gfj4shviE4jiO-zXd_eSMfF-ILb4ISM-u5-68fZLMJCr-F2IhOec1r5ulBg8G50NO4del6k8ZZMFuZQ', 'alg': 'RS256'} [Fri Apr 05 22:54:00.092998 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] signature_check(False) [Fri Apr 05 22:54:00.093627 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] Signature.check() ended with: True:None [Fri Apr 05 22:54:00.093708 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] Message._check() ended with: 200 [Fri Apr 05 22:54:00.093783 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] Message.check() ended with:200 [Fri Apr 05 22:54:00.093838 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] Authorization._authz_info() [Fri Apr 05 22:54:00.093907 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] string_sanitize() [Fri Apr 05 22:54:00.094001 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] Authorization._authz_info(2EYhchmP9rMf) [Fri Apr 05 22:54:00.094069 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] generate_random_string() [Fri Apr 05 22:54:00.094156 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] Authorization._authz_lookup(2EYhchmP9rMf) [Fri Apr 05 22:54:00.094227 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] DBStore.authorization_lookup(column:name, pattern:2EYhchmP9rMf) [Fri Apr 05 22:54:00.094280 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] DBStore._authorization_search(column:name, pattern:2EYhchmP9rMf) [Fri Apr 05 22:54:00.094322 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] rename name to authorization.name [Fri Apr 05 22:54:00.095031 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] DBStore._authorization_search() ended [Fri Apr 05 22:54:00.095197 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] DBStore.authorization_lookup() ended [Fri Apr 05 22:54:00.095324 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] Authorization._authz_lookup() ended [Fri Apr 05 22:54:00.095376 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] Authorization._expiry_update() [Fri Apr 05 22:54:00.095445 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] DBStore.authorization_update({'name': '2EYhchmP9rMf', 'token': 'tCSjYIhBVA5JlmneufL0kGSMMEXatUnG', 'expires': 1712444040}) [Fri Apr 05 22:54:00.095489 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] DBStore._authorization_search(column:name, pattern:2EYhchmP9rMf) [Fri Apr 05 22:54:00.095535 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] rename name to authorization.name [Fri Apr 05 22:54:00.096256 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] DBStore._authorization_search() ended [Fri Apr 05 22:54:00.108530 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] DBStore.authorization_update() ended [Fri Apr 05 22:54:00.108635 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] Authorization._expiry_update() ended [Fri Apr 05 22:54:00.108765 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] Authorization._authz_lookup(2EYhchmP9rMf) [Fri Apr 05 22:54:00.108811 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] DBStore.authorization_lookup(column:name, pattern:2EYhchmP9rMf) [Fri Apr 05 22:54:00.108852 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] DBStore._authorization_search(column:name, pattern:2EYhchmP9rMf) [Fri Apr 05 22:54:00.108888 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] rename name to authorization.name [Fri Apr 05 22:54:00.109766 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] DBStore._authorization_search() ended [Fri Apr 05 22:54:00.109849 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] DBStore.authorization_lookup() ended [Fri Apr 05 22:54:00.109908 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] Authorization._authz_lookup() ended [Fri Apr 05 22:54:00.109959 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] Authorization._authz_info_dic_update() [Fri Apr 05 22:54:00.110003 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] Authorization._authz_info_dic_update() ended [Fri Apr 05 22:54:00.110043 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] Authorization._challengeset_get(2EYhchmP9rMf) [Fri Apr 05 22:54:00.112048 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] _config_load() [Fri Apr 05 22:54:00.113342 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] error_dict_get() [Fri Apr 05 22:54:00.113416 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] Challenge._config_load() [Fri Apr 05 22:54:00.114333 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] Challenge._config_challenge_load() [Fri Apr 05 22:54:00.114483 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] Challenge._config_challenge_load() ended [Fri Apr 05 22:54:00.114556 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] Challenge._config_proxy_load() [Fri Apr 05 22:54:00.114659 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] Challenge._config_proxy_load() ended [Fri Apr 05 22:54:00.114715 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] Challenge._config_load() ended. [Fri Apr 05 22:54:00.114772 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] Authorization._challengeset_get() ended [Fri Apr 05 22:54:00.114812 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] Challenge.challengeset_get() for auth: 2EYhchmP9rMf:lab-acme-test.dbb.az.internal [Fri Apr 05 22:54:00.114865 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] Challenge._challengelist_search() [Fri Apr 05 22:54:00.114919 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] DBStore._challenge_search(column:authorization__name, pattern:2EYhchmP9rMf) [Fri Apr 05 22:54:00.115967 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] DBStore._challenge_search() ended [Fri Apr 05 22:54:00.116269 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] Challenge._challengelist_search() ended with: [{'token': 'r90pSylBzKcHnCkZ0sFDYhdrUJEDGyIF', 'type': 'http-01', 'url': 'https://acmeserver01.acmelab.sec.internal/acme/chall/Mjfw7IcumFaA', 'name': 'Mjfw7IcumFaA', 'status': 'pending'}, {'token': 'r90pSylBzKcHnCkZ0sFDYhdrUJEDGyIF', 'type': 'dns-01', 'url': 'https://acmeserver01.acmelab.sec.internal/acme/chall/HGyWDP97tHFw', 'name': 'HGyWDP97tHFw', 'status': 'processing'}, {'token': 'r90pSylBzKcHnCkZ0sFDYhdrUJEDGyIF', 'type': 'tls-alpn-01', 'url': 'https://acmeserver01.acmelab.sec.internal/acme/chall/kylEtIiqpwIg', 'name': 'kylEtIiqpwIg', 'status': 'pending'}] [Fri Apr 05 22:54:00.116344 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] Challenges found. [Fri Apr 05 22:54:00.116491 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] Authorization._authz_info() returns: {"expires": "2024-04-06T22:54:00Z", "status": "pending", "identifier": {"type": "dns", "value": "lab-acme-test.dbb.az.internal"}, "challenges": [{"token": "r90pSylBzKcHnCkZ0sFDYhdrUJEDGyIF", "type": "http-01", "url": https://acmeserver01.acmelab.sec.internal/acme/chall/Mjfw7IcumFaA, "status": "pending"}, {"token": "r90pSylBzKcHnCkZ0sFDYhdrUJEDGyIF", "type": "dns-01", "url": https://acmeserver01.acmelab.sec.internal/acme/chall/HGyWDP97tHFw, "status": "processing"}, {"token": "r90pSylBzKcHnCkZ0sFDYhdrUJEDGyIF", "type": "tls-alpn-01", "url": https://acmeserver01.acmelab.sec.internal/acme/chall/kylEtIiqpwIg, "status": "pending"}]} [Fri Apr 05 22:54:00.116580 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] Message.prepare_response() [Fri Apr 05 22:54:00.116668 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] Nonce.nonce_generate_and_add() [Fri Apr 05 22:54:00.116706 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] Nonce.nonce__new() [Fri Apr 05 22:54:00.116790 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] got nonce: 39765b3c9874444d9c93ecfbffa3f2e7 [Fri Apr 05 22:54:00.116836 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] DBStore.nonce_add(39765b3c9874444d9c93ecfbffa3f2e7) [Fri Apr 05 22:54:00.128443 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] DBStore.nonce_add() ended [Fri Apr 05 22:54:00.128562 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] Nonce.generate_and_add() ended with:39765b3c9874444d9c93ecfbffa3f2e7 [Fri Apr 05 22:54:00.128680 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] Authorization.new_post() returns: {"data": {"expires": "2024-04-06T22:54:00Z", "status": "pending", "identifier": {"type": "dns", "value": "lab-acme-test.dbb.az.internal"}, "challenges": [{"token": "r90pSylBzKcHnCkZ0sFDYhdrUJEDGyIF", "type": "http-01", "url": https://acmeserver01.acmelab.sec.internal/acme/chall/Mjfw7IcumFaA, "status": "pending"}, {"token": "r90pSylBzKcHnCkZ0sFDYhdrUJEDGyIF", "type": "dns-01", "url": https://acmeserver01.acmelab.sec.internal/acme/chall/HGyWDP97tHFw, "status": "processing"}, {"token": "r90pSylBzKcHnCkZ0sFDYhdrUJEDGyIF", "type": "tls-alpn-01", "url": https://acmeserver01.acmelab.sec.internal/acme/chall/kylEtIiqpwIg, "status": "pending"}]}, "code": 200, "header": {"Replay-Nonce": "39765b3c9874444d9c93ecfbffa3f2e7"}} [Fri Apr 05 22:54:00.128949 2024] [wsgi:error] [pid 551356:tid 139703034394176] [remote 10.57.136.39:50770] 10.57.136.39 /acme/authz/2EYhchmP9rMf {'data': {'expires': '2024-04-06T22:54:00Z', 'status': 'pending', 'identifier': {'type': 'dns', 'value': 'lab-acme-test.dbb.az.internal'}, 'challenges': [{'token': '- modified - ', 'type': 'http-01', 'url': 'https://acmeserver01.acmelab.sec.internal/acme/chall/Mjfw7IcumFaA', 'status': 'pending'}, {'token': '- modified - ', 'type': 'dns-01', 'url': 'https://acmeserver01.acmelab.sec.internal/acme/chall/HGyWDP97tHFw', 'status': 'processing'}, {'token': '- modified - ', 'type': 'tls-alpn-01', 'url': 'https://acmeserver01.acmelab.sec.internal/acme/chall/kylEtIiqpwIg', 'status': 'pending'}]}, 'code': 200, 'header': {'Replay-Nonce': '- modified -'}} [Fri Apr 05 22:54:01.409627 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] _config_load() [Fri Apr 05 22:54:01.410925 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] Authorization._config_load() [Fri Apr 05 22:54:01.411481 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] Authorization._config_load() ended. [Fri Apr 05 22:54:01.411568 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] Authorization.new_post() [Fri Apr 05 22:54:01.411623 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] Authorization.invalidate(None) [Fri Apr 05 22:54:01.411686 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] Authorization.invalidate(): set timestamp to 1712357641 [Fri Apr 05 22:54:01.411735 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] DBStore.authorizations_expired_search(column:expires, pattern:1712357641) [Fri Apr 05 22:54:01.412637 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] DBStore.authorizations_expired_search-() ended [Fri Apr 05 22:54:01.412711 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] Authorization.invalidate() ended: 0 authorizations identified [Fri Apr 05 22:54:01.412823 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] Message.check() [Fri Apr 05 22:54:01.412891 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] decode_message() [Fri Apr 05 22:54:01.413331 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] Message._check() [Fri Apr 05 22:54:01.413392 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] Nonce.check_nonce() [Fri Apr 05 22:54:01.413437 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] Nonce.nonce._check_and_delete(39765b3c9874444d9c93ecfbffa3f2e7) [Fri Apr 05 22:54:01.413537 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] DBStore.nonce_check(39765b3c9874444d9c93ecfbffa3f2e7) [Fri Apr 05 22:54:01.414061 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] DBStore.nonce_check() ended [Fri Apr 05 22:54:01.414157 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] DBStore.nonce_delete(39765b3c9874444d9c93ecfbffa3f2e7) [Fri Apr 05 22:54:01.429782 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] DBStore.nonce_delete() ended [Fri Apr 05 22:54:01.429861 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] Nonce._check_and_delete() ended with:200 [Fri Apr 05 22:54:01.429915 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] Nonce.check_nonce() ended with:200 [Fri Apr 05 22:54:01.429957 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] Message._name_get() [Fri Apr 05 22:54:01.429997 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] kid: https://acmeserver01.acmelab.sec.internal/acme/acct/D9NNGvob2I4F [Fri Apr 05 22:54:01.430046 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] Message._name_get() returns: D9NNGvob2I4F [Fri Apr 05 22:54:01.430673 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] error_dict_get() [Fri Apr 05 22:54:01.431354 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] Signature.check(D9NNGvob2I4F) [Fri Apr 05 22:54:01.431602 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] check signature against account key [Fri Apr 05 22:54:01.431663 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] Signature._jwk_load(D9NNGvob2I4F) [Fri Apr 05 22:54:01.431707 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] DBStore.jwk_load(D9NNGvob2I4F) [Fri Apr 05 22:54:01.431754 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] DBStore._account_search(column:name, pattern:D9NNGvob2I4F) [Fri Apr 05 22:54:01.432307 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] DBStore._account_search() ended with: True [Fri Apr 05 22:54:01.432406 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] DBStore.jwk_load() ended with: {'e': 'AQAB', 'kty': 'RSA', 'n': 'ps9K-qylieUk6XUPWPAnmykVLt5tWYFT418hIqz4okLXE-89a3zHIFJm_Taqyr_4eiSd5lNXv2kTuLmqTgxH55MvuIllRwrHeu9S2V9nJq5B_v3wduGZCe_HvuspqzW5fGj1n6P6iVrO0cyujIAiJD-4Q94jGTIXfn7CKKN31aG1dj3mU1r32KnRDuvanefV15lLbhxqbnXgtPAd4sArTMKJx5ijW5YqLXiMSGNMu5y7A9IJEvIxhE_GL4cPq9EiKvIK-f7gfj4shviE4jiO-zXd_eSMfF-ILb4ISM-u5-68fZLMJCr-F2IhOec1r5ulBg8G50NO4del6k8ZZMFuZQ', 'alg': 'RS256'} [Fri Apr 05 22:54:01.432574 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] signature_check(False) [Fri Apr 05 22:54:01.433251 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] Signature.check() ended with: True:None [Fri Apr 05 22:54:01.433313 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] Message._check() ended with: 200 [Fri Apr 05 22:54:01.433359 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] Message.check() ended with:200 [Fri Apr 05 22:54:01.433405 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] Authorization._authz_info() [Fri Apr 05 22:54:01.433448 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] string_sanitize() [Fri Apr 05 22:54:01.433517 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] Authorization._authz_info(2EYhchmP9rMf) [Fri Apr 05 22:54:01.433579 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] generate_random_string() [Fri Apr 05 22:54:01.433659 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] Authorization._authz_lookup(2EYhchmP9rMf) [Fri Apr 05 22:54:01.433739 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] DBStore.authorization_lookup(column:name, pattern:2EYhchmP9rMf) [Fri Apr 05 22:54:01.433811 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] DBStore._authorization_search(column:name, pattern:2EYhchmP9rMf) [Fri Apr 05 22:54:01.433851 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] rename name to authorization.name [Fri Apr 05 22:54:01.434639 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] DBStore._authorization_search() ended [Fri Apr 05 22:54:01.434724 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] DBStore.authorization_lookup() ended [Fri Apr 05 22:54:01.434768 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] Authorization._authz_lookup() ended [Fri Apr 05 22:54:01.434812 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] Authorization._expiry_update() [Fri Apr 05 22:54:01.434861 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] DBStore.authorization_update({'name': '2EYhchmP9rMf', 'token': 'PzLajYePkDrdn4VicOHj72hrBbbvWotV', 'expires': 1712444041}) [Fri Apr 05 22:54:01.434913 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] DBStore._authorization_search(column:name, pattern:2EYhchmP9rMf) [Fri Apr 05 22:54:01.434950 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] rename name to authorization.name [Fri Apr 05 22:54:01.435619 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] DBStore._authorization_search() ended [Fri Apr 05 22:54:01.450036 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] DBStore.authorization_update() ended [Fri Apr 05 22:54:01.450132 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] Authorization._expiry_update() ended [Fri Apr 05 22:54:01.450276 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] Authorization._authz_lookup(2EYhchmP9rMf) [Fri Apr 05 22:54:01.450331 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] DBStore.authorization_lookup(column:name, pattern:2EYhchmP9rMf) [Fri Apr 05 22:54:01.450375 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] DBStore._authorization_search(column:name, pattern:2EYhchmP9rMf) [Fri Apr 05 22:54:01.450414 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] rename name to authorization.name [Fri Apr 05 22:54:01.451069 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] DBStore._authorization_search() ended [Fri Apr 05 22:54:01.451143 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] DBStore.authorization_lookup() ended [Fri Apr 05 22:54:01.451183 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] Authorization._authz_lookup() ended [Fri Apr 05 22:54:01.451226 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] Authorization._authz_info_dic_update() [Fri Apr 05 22:54:01.451264 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] Authorization._authz_info_dic_update() ended [Fri Apr 05 22:54:01.451320 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] Authorization._challengeset_get(2EYhchmP9rMf) [Fri Apr 05 22:54:01.452583 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] _config_load() [Fri Apr 05 22:54:01.453246 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] error_dict_get() [Fri Apr 05 22:54:01.453334 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] Challenge._config_load() [Fri Apr 05 22:54:01.453932 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] Challenge._config_challenge_load() [Fri Apr 05 22:54:01.454047 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] Challenge._config_challenge_load() ended [Fri Apr 05 22:54:01.454147 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] Challenge._config_proxy_load() [Fri Apr 05 22:54:01.454223 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] Challenge._config_proxy_load() ended [Fri Apr 05 22:54:01.454271 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] Challenge._config_load() ended. [Fri Apr 05 22:54:01.454311 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] Authorization._challengeset_get() ended [Fri Apr 05 22:54:01.454361 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] Challenge.challengeset_get() for auth: 2EYhchmP9rMf:lab-acme-test.dbb.az.internal [Fri Apr 05 22:54:01.454425 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] Challenge._challengelist_search() [Fri Apr 05 22:54:01.454481 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] DBStore._challenge_search(column:authorization__name, pattern:2EYhchmP9rMf) [Fri Apr 05 22:54:01.455328 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] DBStore._challenge_search() ended [Fri Apr 05 22:54:01.455483 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] Challenge._challengelist_search() ended with: [{'token': 'r90pSylBzKcHnCkZ0sFDYhdrUJEDGyIF', 'type': 'http-01', 'url': 'https://acmeserver01.acmelab.sec.internal/acme/chall/Mjfw7IcumFaA', 'name': 'Mjfw7IcumFaA', 'status': 'pending'}, {'token': 'r90pSylBzKcHnCkZ0sFDYhdrUJEDGyIF', 'type': 'dns-01', 'url': 'https://acmeserver01.acmelab.sec.internal/acme/chall/HGyWDP97tHFw', 'name': 'HGyWDP97tHFw', 'status': 'processing'}, {'token': 'r90pSylBzKcHnCkZ0sFDYhdrUJEDGyIF', 'type': 'tls-alpn-01', 'url': 'https://acmeserver01.acmelab.sec.internal/acme/chall/kylEtIiqpwIg', 'name': 'kylEtIiqpwIg', 'status': 'pending'}] [Fri Apr 05 22:54:01.455554 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] Challenges found. [Fri Apr 05 22:54:01.455643 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] Authorization._authz_info() returns: {"expires": "2024-04-06T22:54:01Z", "status": "pending", "identifier": {"type": "dns", "value": "lab-acme-test.dbb.az.internal"}, "challenges": [{"token": "r90pSylBzKcHnCkZ0sFDYhdrUJEDGyIF", "type": "http-01", "url": https://acmeserver01.acmelab.sec.internal/acme/chall/Mjfw7IcumFaA, "status": "pending"}, {"token": "r90pSylBzKcHnCkZ0sFDYhdrUJEDGyIF", "type": "dns-01", "url": https://acmeserver01.acmelab.sec.internal/acme/chall/HGyWDP97tHFw, "status": "processing"}, {"token": "r90pSylBzKcHnCkZ0sFDYhdrUJEDGyIF", "type": "tls-alpn-01", "url": https://acmeserver01.acmelab.sec.internal/acme/chall/kylEtIiqpwIg, "status": "pending"}]} [Fri Apr 05 22:54:01.455698 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] Message.prepare_response() [Fri Apr 05 22:54:01.455745 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] Nonce.nonce_generate_and_add() [Fri Apr 05 22:54:01.455787 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] Nonce.nonce__new() [Fri Apr 05 22:54:01.455856 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] got nonce: f8a7c72dcfb24ddcbdf752108a1525c5 [Fri Apr 05 22:54:01.455895 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] DBStore.nonce_add(f8a7c72dcfb24ddcbdf752108a1525c5) [Fri Apr 05 22:54:01.466881 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] DBStore.nonce_add() ended [Fri Apr 05 22:54:01.466955 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] Nonce.generate_and_add() ended with:f8a7c72dcfb24ddcbdf752108a1525c5 [Fri Apr 05 22:54:01.467044 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] Authorization.new_post() returns: {"data": {"expires": "2024-04-06T22:54:01Z", "status": "pending", "identifier": {"type": "dns", "value": "lab-acme-test.dbb.az.internal"}, "challenges": [{"token": "r90pSylBzKcHnCkZ0sFDYhdrUJEDGyIF", "type": "http-01", "url": https://acmeserver01.acmelab.sec.internal/acme/chall/Mjfw7IcumFaA, "status": "pending"}, {"token": "r90pSylBzKcHnCkZ0sFDYhdrUJEDGyIF", "type": "dns-01", "url": https://acmeserver01.acmelab.sec.internal/acme/chall/HGyWDP97tHFw, "status": "processing"}, {"token": "r90pSylBzKcHnCkZ0sFDYhdrUJEDGyIF", "type": "tls-alpn-01", "url": https://acmeserver01.acmelab.sec.internal/acme/chall/kylEtIiqpwIg, "status": "pending"}]}, "code": 200, "header": {"Replay-Nonce": "f8a7c72dcfb24ddcbdf752108a1525c5"}} [Fri Apr 05 22:54:01.467232 2024] [wsgi:error] [pid 551356:tid 139702933681728] [remote 10.57.136.39:50782] 10.57.136.39 /acme/authz/2EYhchmP9rMf {'data': {'expires': '2024-04-06T22:54:01Z', 'status': 'pending', 'identifier': {'type': 'dns', 'value': 'lab-acme-test.dbb.az.internal'}, 'challenges': [{'token': '- modified - ', 'type': 'http-01', 'url': 'https://acmeserver01.acmelab.sec.internal/acme/chall/Mjfw7IcumFaA', 'status': 'pending'}, {'token': '- modified - ', 'type': 'dns-01', 'url': 'https://acmeserver01.acmelab.sec.internal/acme/chall/HGyWDP97tHFw', 'status': 'processing'}, {'token': '- modified - ', 'type': 'tls-alpn-01', 'url': 'https://acmeserver01.acmelab.sec.internal/acme/chall/kylEtIiqpwIg', 'status': 'pending'}]}, 'code': 200, 'header': {'Replay-Nonce': '- modified -'}} ^C acmeadmin@acmeserver01:~$ dig TXT _acme-challenge.lab-acme-test.dbb.az.internal

; <<>> DiG 9.18.18-0ubuntu0.22.04.1-Ubuntu <<>> TXT _acme-challenge.lab-acme-test.dbb.az.internal ;; global options: +cmd ;; Got answer: ;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 7848 ;; flags: qr rd ra; QUERY: 1, ANSWER: 2, AUTHORITY: 0, ADDITIONAL: 1

;; OPT PSEUDOSECTION: ; EDNS: version: 0, flags:; udp: 65494 ;; QUESTION SECTION: ;_acme-challenge.lab-acme-test.dbb.az.internal. IN TXT

;; ANSWER SECTION: _acme-challenge.lab-acme-test.dbb.az.internal. 300 IN CNAME dfa6dd1a-bce3-4909-a980-7a398cb0fe97.acmedns01.acmelab.sec.internal. dfa6dd1a-bce3-4909-a980-7a398cb0fe97.acmedns01.acmelab.sec.internal. 1 IN TXT "gD68zsssZidwKLUFZeMD-2BGKruXBdYesnezLfOJpjk"

;; Query time: 108 msec ;; SERVER: 127.0.0.53#53(127.0.0.53) (UDP) ;; WHEN: Fri Apr 05 22:54:09 UTC 2024 ;; MSG SIZE rcvd: 211

acmeadmin@acmeserver01:~$