harbor-helm [Harbor 2.6.0 / Swift] Fails to finilize image push

[Harbor 2.6.0 / Swift] Fails to finilize image push

Open Kanshiroron opened this issue 2 years ago • 1 comments

Recreation of https://github.com/goharbor/harbor/issues/17633

Expected behavior and actual behavior: I'm trying to push a small image to a new Harbor deployment, but it fails to finalize. The behavior is following:

The push starts correctly, we see each image layer being uploaded up to then but the status doesn't change to uploaded, instead it fails and retry.

$ docker push harbor.example.com/devops/nginx:test
The push refers to repository [harbor.example.com/devops/nginx]
d6a3537fc36a: Pushing [==================================================>]  7.168kB
819eb3a45632: Pushing [==================================================>]  3.584kB
5eda6fa69be4: Pushing [==================================================>]  4.096kB
6f4f3ce1dca0: Pushing [==================================================>]  3.072kB
58a06a0d345c: Pushing [===========================================>       ]  52.95MB/61.15MB
fe7b1e9bf792: Waiting

$ docker push harbor.example.com/devops/nginx:test
The push refers to repository [harbor.example.com/devops/nginx]
d6a3537fc36a: Retrying in 6 seconds 
819eb3a45632: Retrying in 6 seconds 
5eda6fa69be4: Retrying in 7 seconds 
6f4f3ce1dca0: Retrying in 7 seconds 
58a06a0d345c: Retrying in 3 seconds 
fe7b1e9bf792: Waiting

After retrying multiple times, it finaly fails with the error: x509: certificate signed by unknown authority, which is weird: Harbor is indeed served with TLS but not using a self-sign certificate (and I can run docker login without any issue). We are using OpenStack Swift as the backend storage (persistence has been disabled), it does uses a self-signed certificate but the insecureskipverify option has been set to true in the Swift section, and I do see blobs in the Swift bucket.

I've checked https://github.com/goharbor/harbor/issues/10840, https://github.com/goharbor/harbor-helm/issues/1285 and https://github.com/goharbor/harbor/issues/11437 but I don't think those are related.

Versions:

Kubernetes version: 1.20
containerd version: 1.5.9
Helm version: 3.5.3
Harbor chart version: 1.10.0
harbor version: 2.6.0 (chart's defaults)
Docker client version: 20.10.18 (used to push the image)

Log files:

I wasn't able to find anything relevant in the logs, but here they are:

Harbor core (debug):

2022-10-06T11:07:00Z [DEBUG] [/server/middleware/log/log.go:30]: attach request id ccf427004d679ac5e35b967c2a3d5ede to the logger for the request POST /v2/devops/nginx/blobs/uploads/
2022-10-06T11:07:00Z [DEBUG] [/server/middleware/artifactinfo/artifact_info.go:54]: In artifact info middleware, url: /v2/devops/nginx/blobs/uploads/
2022-10-06T11:07:00Z [DEBUG] [/server/middleware/quota/quota.go:103][action="request" middleware="quota" requestID="ccf427004d679ac5e35b967c2a3d5ede" url="/v2/devops/nginx/blobs/uploads/"]: no resources request for this http request, so direct to next handler
2022-10-06T11:07:02Z [DEBUG] [/server/middleware/log/log.go:30]: attach request id 313a51d04af5dfcb2435c2c2740331ec to the logger for the request PATCH /v2/devops/nginx/blobs/uploads/a0d792e5-7eb8-4d8c-a82a-db0a188df7d4
2022-10-06T11:07:02Z [DEBUG] [/server/middleware/artifactinfo/artifact_info.go:54]: In artifact info middleware, url: /v2/devops/nginx/blobs/uploads/a0d792e5-7eb8-4d8c-a82a-db0a188df7d4?_state=0J44BVIoYk9MGvz4O5tahFSn24xxvmBZIfFIxTVFXAd7Ik5hbWUiOiJkZXZvcHMvbmdpbngiLCJVVUlEIjoiYTBkNzkyZTUtN2ViOC00ZDhjLWE4MmEtZGIwYTE4OGRmN2Q0IiwiT2Zmc2V0IjowLCJTdGFydGVkQXQiOiIyMDIyLTEwLTA2VDExOjA3OjAwLjUyMTYxMzQ3OVoifQ%3D%3D
2022-10-06T11:07:02Z [DEBUG] [/server/middleware/log/log.go:30]: attach request id 144eb8137e831af8670c2bddaef69657 to the logger for the request PATCH /v2/devops/nginx/blobs/uploads/5315c1b1-0268-4994-ba2d-92130eacca41
2022-10-06T11:07:02Z [DEBUG] [/server/middleware/artifactinfo/artifact_info.go:54]: In artifact info middleware, url: /v2/devops/nginx/blobs/uploads/5315c1b1-0268-4994-ba2d-92130eacca41?_state=Vk_exiPBsNAtnSHvb2HczW2HXgiJEUkZ4WJcbnCB3417Ik5hbWUiOiJkZXZvcHMvbmdpbngiLCJVVUlEIjoiNTMxNWMxYjEtMDI2OC00OTk0LWJhMmQtOTIxMzBlYWNjYTQxIiwiT2Zmc2V0IjowLCJTdGFydGVkQXQiOiIyMDIyLTEwLTA2VDExOjA2OjU5LjU0NDEyNDIwM1oifQ%3D%3D
2022-10-06T11:07:03Z [DEBUG] [/server/middleware/log/log.go:30]: attach request id b0e0af39-35ca-4c67-b865-b5522780fc6a to the logger for the request GET /api/v2.0/ping
2022-10-06T11:07:03Z [DEBUG] [/server/middleware/artifactinfo/artifact_info.go:54]: In artifact info middleware, url: /api/v2.0/ping
2022-10-06T11:07:03Z [DEBUG] [/server/middleware/security/unauthorized.go:28][requestID="b0e0af39-35ca-4c67-b865-b5522780fc6a"]: an unauthorized security context generated for request GET /api/v2.0/ping
2022-10-06T11:07:06Z [DEBUG] [/server/middleware/log/log.go:30]: attach request id e177b7f3e84259d38b91d04186f139fe to the logger for the request PUT /v2/devops/nginx/blobs/uploads/a0d792e5-7eb8-4d8c-a82a-db0a188df7d4
2022-10-06T11:07:06Z [DEBUG] [/server/middleware/artifactinfo/artifact_info.go:54]: In artifact info middleware, url: /v2/devops/nginx/blobs/uploads/a0d792e5-7eb8-4d8c-a82a-db0a188df7d4?_state=Bx3hWR6fSbKnfaAV3yX89YgrCWaVqcYGaZkmXELnLtt7Ik5hbWUiOiJkZXZvcHMvbmdpbngiLCJVVUlEIjoiYTBkNzkyZTUtN2ViOC00ZDhjLWE4MmEtZGIwYTE4OGRmN2Q0IiwiT2Zmc2V0Ijo2NjUsIlN0YXJ0ZWRBdCI6IjIwMjItMTAtMDZUMTE6MDc6MDBaIn0%3D&digest=sha256%3Af5d8edcd47b1b04e279cc2414cad5c38b423d1d5ee9801ca7c81ef63d0941c98
2022-10-06T11:07:06Z [DEBUG] [/server/middleware/quota/quota.go:103][action="request" middleware="quota" requestID="e177b7f3e84259d38b91d04186f139fe" url="/v2/devops/nginx/blobs/uploads/a0d792e5-7eb8-4d8c-a82a-db0a188df7d4"]: no resources request for this http request, so direct to next handler
2022-10-06T11:07:06Z [DEBUG] [/server/middleware/log/log.go:30]: attach request id 068da9681b12cbb79e4dfe6a8f2aa23d to the logger for the request PUT /v2/devops/nginx/blobs/uploads/5315c1b1-0268-4994-ba2d-92130eacca41
2022-10-06T11:07:06Z [DEBUG] [/server/middleware/artifactinfo/artifact_info.go:54]: In artifact info middleware, url: /v2/devops/nginx/blobs/uploads/5315c1b1-0268-4994-ba2d-92130eacca41?_state=x0d6cyfM_nkxVmnkmLsbG1uzsNElKWy2kNhUNmRNin17Ik5hbWUiOiJkZXZvcHMvbmdpbngiLCJVVUlEIjoiNTMxNWMxYjEtMDI2OC00OTk0LWJhMmQtOTIxMzBlYWNjYTQxIiwiT2Zmc2V0IjoxMzk0LCJTdGFydGVkQXQiOiIyMDIyLTEwLTA2VDExOjA2OjU5WiJ9&digest=sha256%3Afe24ce36f968b9315f7713fee767d50444dea2b59951f171054cb4e3c12d4b81
2022-10-06T11:07:06Z [DEBUG] [/server/middleware/quota/quota.go:103][action="request" middleware="quota" requestID="068da9681b12cbb79e4dfe6a8f2aa23d" url="/v2/devops/nginx/blobs/uploads/5315c1b1-0268-4994-ba2d-92130eacca41"]: no resources request for this http request, so direct to next handler
2022-10-06T11:07:08Z [DEBUG] [/server/middleware/log/log.go:30]: attach request id 2876287e-2cdc-44a0-bf80-e8f8351c2110 to the logger for the request GET /api/v2.0/ping
2022-10-06T11:07:08Z [DEBUG] [/server/middleware/artifactinfo/artifact_info.go:54]: In artifact info middleware, url: /api/v2.0/ping
2022-10-06T11:07:08Z [DEBUG] [/server/middleware/security/unauthorized.go:28][requestID="2876287e-2cdc-44a0-bf80-e8f8351c2110"]: an unauthorized security context generated for request GET /api/v2.0/ping
2022-10-06T11:07:13Z [DEBUG] [/server/middleware/log/log.go:30]: attach request id 9e570b00-ee63-481b-a6b9-54ef30b6e99d to the logger for the request GET /api/v2.0/ping
2022-10-06T11:07:13Z [DEBUG] [/server/middleware/artifactinfo/artifact_info.go:54]: In artifact info middleware, url: /api/v2.0/ping
2022-10-06T11:07:13Z [DEBUG] [/server/middleware/security/unauthorized.go:28][requestID="9e570b00-ee63-481b-a6b9-54ef30b6e99d"]: an unauthorized security context generated for request GET /api/v2.0/ping
2022-10-06T11:07:15Z [DEBUG] [/server/middleware/log/log.go:30]: attach request id ef3817d464938912fbb55e7e57f3b72b to the logger for the request PUT /v2/devops/nginx/blobs/uploads/ed5c81d4-5468-4fca-9c97-3d7c7d4d41c7
2022-10-06T11:07:15Z [DEBUG] [/server/middleware/artifactinfo/artifact_info.go:54]: In artifact info middleware, url: /v2/devops/nginx/blobs/uploads/ed5c81d4-5468-4fca-9c97-3d7c7d4d41c7?_state=zT6265sYrKrqxeMM-fe8pVsiA8AkdU29r5JEluybK-F7Ik5hbWUiOiJkZXZvcHMvbmdpbngiLCJVVUlEIjoiZWQ1YzgxZDQtNTQ2OC00ZmNhLTljOTctM2Q3YzdkNGQ0MWM3IiwiT2Zmc2V0IjoyNTM0OTQ5MiwiU3RhcnRlZEF0IjoiMjAyMi0xMC0wNlQxMTowNjo1M1oifQ%3D%3D&digest=sha256%3A8d634ce99fb933cae83bf1ebc98ca6a4bc683f632320ececee060ea84d2785fe
2022-10-06T11:07:15Z [DEBUG] [/server/middleware/quota/quota.go:103][action="request" middleware="quota" requestID="ef3817d464938912fbb55e7e57f3b72b" url="/v2/devops/nginx/blobs/uploads/ed5c81d4-5468-4fca-9c97-3d7c7d4d41c7"]: no resources request for this http request, so direct to next handler
2022-10-06T11:07:17Z [DEBUG] [/server/middleware/log/log.go:30]: attach request id 632ee541a769e8cac4ff3d4e38eebeaf to the logger for the request HEAD /v2/devops/nginx/blobs/sha256:f5d8edcd47b1b04e279cc2414cad5c38b423d1d5ee9801ca7c81ef63d0941c98
2022-10-06T11:07:17Z [DEBUG] [/server/middleware/artifactinfo/artifact_info.go:54]: In artifact info middleware, url: /v2/devops/nginx/blobs/sha256:f5d8edcd47b1b04e279cc2414cad5c38b423d1d5ee9801ca7c81ef63d0941c98
2022-10-06T11:07:18Z [DEBUG] [/server/middleware/log/log.go:30]: attach request id 02d5c2b6361fbddb5d4a92652e372d6a to the logger for the request HEAD /v2/devops/nginx/blobs/sha256:fe24ce36f968b9315f7713fee767d50444dea2b59951f171054cb4e3c12d4b81
2022-10-06T11:07:18Z [DEBUG] [/server/middleware/artifactinfo/artifact_info.go:54]: In artifact info middleware, url: /v2/devops/nginx/blobs/sha256:fe24ce36f968b9315f7713fee767d50444dea2b59951f171054cb4e3c12d4b81
2022-10-06T11:07:18Z [DEBUG] [/server/middleware/log/log.go:30]: attach request id e87447ea-fe6d-4932-9b7f-584ff5700820 to the logger for the request GET /api/v2.0/ping
2022-10-06T11:07:18Z [DEBUG] [/server/middleware/artifactinfo/artifact_info.go:54]: In artifact info middleware, url: /api/v2.0/ping
2022-10-06T11:07:18Z [DEBUG] [/server/middleware/security/unauthorized.go:28][requestID="e87447ea-fe6d-4932-9b7f-584ff5700820"]: an unauthorized security context generated for request GET /api/v2.0/ping
2022-10-06T11:07:23Z [DEBUG] [/server/middleware/log/log.go:30]: attach request id 11508bec-2c1f-41aa-ab0d-0f7cb8ccf784 to the logger for the request GET /api/v2.0/ping
2022-10-06T11:07:23Z [DEBUG] [/server/middleware/artifactinfo/artifact_info.go:54]: In artifact info middleware, url: /api/v2.0/ping
2022-10-06T11:07:23Z [DEBUG] [/server/middleware/security/unauthorized.go:28][requestID="11508bec-2c1f-41aa-ab0d-0f7cb8ccf784"]: an unauthorized security context generated for request GET /api/v2.0/ping
2022-10-06T11:07:26Z [DEBUG] [/server/middleware/log/log.go:30]: attach request id 87fb55d0070c80de44a1b431cdfd118b to the logger for the request HEAD /v2/devops/nginx/blobs/sha256:8d634ce99fb933cae83bf1ebc98ca6a4bc683f632320ececee060ea84d2785fe
2022-10-06T11:07:26Z [DEBUG] [/server/middleware/artifactinfo/artifact_info.go:54]: In artifact info middleware, url: /v2/devops/nginx/blobs/sha256:8d634ce99fb933cae83bf1ebc98ca6a4bc683f632320ececee060ea84d2785fe
2022-10-06T11:07:28Z [DEBUG] [/server/middleware/log/log.go:30]: attach request id 959f3117-5084-4198-843b-0d83572dfe8c to the logger for the request GET /api/v2.0/ping
2022-10-06T11:07:28Z [DEBUG] [/server/middleware/artifactinfo/artifact_info.go:54]: In artifact info middleware, url: /api/v2.0/ping
2022-10-06T11:07:28Z [DEBUG] [/server/middleware/security/unauthorized.go:28][requestID="959f3117-5084-4198-843b-0d83572dfe8c"]: an unauthorized security context generated for request GET /api/v2.0/ping
2022-10-06T11:07:33Z [DEBUG] [/server/middleware/log/log.go:30]: attach request id 48208dac-5cda-4795-a8d5-d51e915bfc9f to the logger for the request GET /api/v2.0/ping
2022-10-06T11:07:33Z [DEBUG] [/server/middleware/artifactinfo/artifact_info.go:54]: In artifact info middleware, url: /api/v2.0/ping
2022-10-06T11:07:33Z [DEBUG] [/server/middleware/security/unauthorized.go:28][requestID="48208dac-5cda-4795-a8d5-d51e915bfc9f"]: an unauthorized security context generated for request GET /api/v2.0/ping
2022-10-06T11:07:38Z [DEBUG] [/server/middleware/log/log.go:30]: attach request id c595aafbd3ff4ef13e01134b2ea498bb to the logger for the request POST /v2/devops/nginx/blobs/uploads/
2022-10-06T11:07:38Z [DEBUG] [/server/middleware/artifactinfo/artifact_info.go:54]: In artifact info middleware, url: /v2/devops/nginx/blobs/uploads/
2022-10-06T11:07:38Z [DEBUG] [/server/middleware/quota/quota.go:103][action="request" middleware="quota" requestID="c595aafbd3ff4ef13e01134b2ea498bb" url="/v2/devops/nginx/blobs/uploads/"]: no resources request for this http request, so direct to next handler
2022-10-06T11:07:38Z [DEBUG] [/server/middleware/log/log.go:30]: attach request id 84a93ddb-e74c-4b51-a91d-8ca320ecd43c to the logger for the request GET /api/v2.0/ping
2022-10-06T11:07:38Z [DEBUG] [/server/middleware/artifactinfo/artifact_info.go:54]: In artifact info middleware, url: /api/v2.0/ping
2022-10-06T11:07:38Z [DEBUG] [/server/middleware/security/unauthorized.go:28][requestID="84a93ddb-e74c-4b51-a91d-8ca320ecd43c"]: an unauthorized security context generated for request GET /api/v2.0/ping
2022-10-06T11:07:39Z [DEBUG] [/server/middleware/log/log.go:30]: attach request id ecff4b3800dd0b16945ae7d528fcd961 to the logger for the request PATCH /v2/devops/nginx/blobs/uploads/eef200ba-9b4a-4f95-bc16-2cf7812a714c
2022-10-06T11:07:39Z [DEBUG] [/server/middleware/artifactinfo/artifact_info.go:54]: In artifact info middleware, url: /v2/devops/nginx/blobs/uploads/eef200ba-9b4a-4f95-bc16-2cf7812a714c?_state=VZwi5jnGNmavJ0v1pfdPbk1ZJ2L0Q35Nyu2Wp772_Ot7Ik5hbWUiOiJkZXZvcHMvbmdpbngiLCJVVUlEIjoiZWVmMjAwYmEtOWI0YS00Zjk1LWJjMTYtMmNmNzgxMmE3MTRjIiwiT2Zmc2V0IjowLCJTdGFydGVkQXQiOiIyMDIyLTEwLTA2VDExOjA3OjM3LjczNjg5MjkzNloifQ%3D%3D
2022-10-06T11:07:43Z [DEBUG] [/server/middleware/log/log.go:30]: attach request id 49dd3f33-2000-449f-9851-452016c2a652 to the logger for the request GET /api/v2.0/ping
2022-10-06T11:07:43Z [DEBUG] [/server/middleware/artifactinfo/artifact_info.go:54]: In artifact info middleware, url: /api/v2.0/ping
2022-10-06T11:07:43Z [DEBUG] [/server/middleware/security/unauthorized.go:28][requestID="49dd3f33-2000-449f-9851-452016c2a652"]: an unauthorized security context generated for request GET /api/v2.0/ping
2022-10-06T11:07:46Z [DEBUG] [/server/middleware/log/log.go:30]: attach request id 5516e79eef9c69e942230306515b3c4c to the logger for the request PUT /v2/devops/nginx/blobs/uploads/a8e3d113-0749-41c5-9851-3758656adde6
2022-10-06T11:07:46Z [DEBUG] [/server/middleware/log/log.go:30]: attach request id df85788cada266a07b0d24ff85efac7c to the logger for the request POST /v2/devops/nginx/blobs/uploads/
2022-10-06T11:07:46Z [DEBUG] [/server/middleware/artifactinfo/artifact_info.go:54]: In artifact info middleware, url: /v2/devops/nginx/blobs/uploads/a8e3d113-0749-41c5-9851-3758656adde6?_state=-5KaWoumfoEQ38tUJIEL3nMDcDHss2c29FqEIHr5z_t7Ik5hbWUiOiJkZXZvcHMvbmdpbngiLCJVVUlEIjoiYThlM2QxMTMtMDc0OS00MWM1LTk4NTEtMzc1ODY1NmFkZGU2IiwiT2Zmc2V0Ijo2NjUsIlN0YXJ0ZWRBdCI6IjIwMjItMTAtMDZUMTE6MDc6MzhaIn0%3D&digest=sha256%3Af5d8edcd47b1b04e279cc2414cad5c38b423d1d5ee9801ca7c81ef63d0941c98
2022-10-06T11:07:46Z [DEBUG] [/server/middleware/artifactinfo/artifact_info.go:54]: In artifact info middleware, url: /v2/devops/nginx/blobs/uploads/
2022-10-06T11:07:46Z [DEBUG] [/server/middleware/quota/quota.go:103][action="request" middleware="quota" requestID="5516e79eef9c69e942230306515b3c4c" url="/v2/devops/nginx/blobs/uploads/a8e3d113-0749-41c5-9851-3758656adde6"]: no resources request for this http request, so direct to next handler
2022-10-06T11:07:46Z [DEBUG] [/server/middleware/quota/quota.go:103][action="request" middleware="quota" requestID="df85788cada266a07b0d24ff85efac7c" url="/v2/devops/nginx/blobs/uploads/"]: no resources request for this http request, so direct to next handler
2022-10-06T11:07:46Z [DEBUG] [/server/middleware/log/log.go:30]: attach request id 44c10371b7e45bb1da6c70fef4689955 to the logger for the request PATCH /v2/devops/nginx/blobs/uploads/8d8f2f9a-0718-46b3-96ba-9ca315fc0042
2022-10-06T11:07:46Z [DEBUG] [/server/middleware/artifactinfo/artifact_info.go:54]: In artifact info middleware, url: /v2/devops/nginx/blobs/uploads/8d8f2f9a-0718-46b3-96ba-9ca315fc0042?_state=odNn1a2hJ0qOjoD9QX9iw27Na01KGAxyJtCxf_glk-F7Ik5hbWUiOiJkZXZvcHMvbmdpbngiLCJVVUlEIjoiOGQ4ZjJmOWEtMDcxOC00NmIzLTk2YmEtOWNhMzE1ZmMwMDQyIiwiT2Zmc2V0IjowLCJTdGFydGVkQXQiOiIyMDIyLTEwLTA2VDExOjA3OjM4LjkyNzgxOTU4MloifQ%3D%3D
2022-10-06T11:07:48Z [DEBUG] [/server/middleware/log/log.go:30]: attach request id 1e924fc3-cc73-463d-9241-e23cfbd70a4a to the logger for the request GET /api/v2.0/ping
2022-10-06T11:07:48Z [DEBUG] [/server/middleware/artifactinfo/artifact_info.go:54]: In artifact info middleware, url: /api/v2.0/ping
2022-10-06T11:07:48Z [DEBUG] [/server/middleware/security/unauthorized.go:28][requestID="1e924fc3-cc73-463d-9241-e23cfbd70a4a"]: an unauthorized security context generated for request GET /api/v2.0/ping
2022-10-06T11:07:50Z [DEBUG] [/server/middleware/log/log.go:30]: attach request id 7aa429be60422d85ed7986b0944da8a3 to the logger for the request PUT /v2/devops/nginx/blobs/uploads/8d8f2f9a-0718-46b3-96ba-9ca315fc0042
2022-10-06T11:07:50Z [DEBUG] [/server/middleware/artifactinfo/artifact_info.go:54]: In artifact info middleware, url: /v2/devops/nginx/blobs/uploads/8d8f2f9a-0718-46b3-96ba-9ca315fc0042?_state=2oHAgGVoe1PQ7qKaZg8LBSlvbxBt2zdGK07iIuRdbmt7Ik5hbWUiOiJkZXZvcHMvbmdpbngiLCJVVUlEIjoiOGQ4ZjJmOWEtMDcxOC00NmIzLTk2YmEtOWNhMzE1ZmMwMDQyIiwiT2Zmc2V0Ijo4OTMsIlN0YXJ0ZWRBdCI6IjIwMjItMTAtMDZUMTE6MDc6MzhaIn0%3D&digest=sha256%3A6ab6a6301bdeddbcd0e6193262b2c54740f4ea12640c81c951223cdd5ec842a3
2022-10-06T11:07:50Z [DEBUG] [/server/middleware/quota/quota.go:103][action="request" middleware="quota" requestID="7aa429be60422d85ed7986b0944da8a3" url="/v2/devops/nginx/blobs/uploads/8d8f2f9a-0718-46b3-96ba-9ca315fc0042"]: no resources request for this http request, so direct to next handler
2022-10-06T11:07:53Z [DEBUG] [/server/middleware/log/log.go:30]: attach request id d9f87c69-6bee-40d0-9a64-fd0113682cb5 to the logger for the request GET /api/v2.0/ping
2022-10-06T11:07:53Z [DEBUG] [/server/middleware/artifactinfo/artifact_info.go:54]: In artifact info middleware, url: /api/v2.0/ping
2022-10-06T11:07:53Z [DEBUG] [/server/middleware/security/unauthorized.go:28][requestID="d9f87c69-6bee-40d0-9a64-fd0113682cb5"]: an unauthorized security context generated for request GET /api/v2.0/ping
2022-10-06T11:07:57Z [DEBUG] [/server/middleware/log/log.go:30]: attach request id 49a72632c748534b5aa8623407f0f2a2 to the logger for the request HEAD /v2/devops/nginx/blobs/sha256:f5d8edcd47b1b04e279cc2414cad5c38b423d1d5ee9801ca7c81ef63d0941c98
2022-10-06T11:07:57Z [DEBUG] [/server/middleware/artifactinfo/artifact_info.go:54]: In artifact info middleware, url: /v2/devops/nginx/blobs/sha256:f5d8edcd47b1b04e279cc2414cad5c38b423d1d5ee9801ca7c81ef63d0941c98
2022-10-06T11:07:58Z [DEBUG] [/server/middleware/log/log.go:30]: attach request id 237d9c774159528a8f56cc2d8deb5b14 to the logger for the request POST /v2/devops/nginx/blobs/uploads/
2022-10-06T11:07:58Z [DEBUG] [/server/middleware/artifactinfo/artifact_info.go:54]: In artifact info middleware, url: /v2/devops/nginx/blobs/uploads/
2022-10-06T11:07:58Z [DEBUG] [/server/middleware/quota/quota.go:103][action="request" middleware="quota" requestID="237d9c774159528a8f56cc2d8deb5b14" url="/v2/devops/nginx/blobs/uploads/"]: no resources request for this http request, so direct to next handler
2022-10-06T11:07:58Z [DEBUG] [/server/middleware/log/log.go:30]: attach request id 5598c4f0-4fb9-4ebc-87bc-c5becc91620e to the logger for the request GET /api/v2.0/ping
2022-10-06T11:07:58Z [DEBUG] [/server/middleware/artifactinfo/artifact_info.go:54]: In artifact info middleware, url: /api/v2.0/ping
2022-10-06T11:07:58Z [DEBUG] [/server/middleware/security/unauthorized.go:28][requestID="5598c4f0-4fb9-4ebc-87bc-c5becc91620e"]: an unauthorized security context generated for request GET /api/v2.0/ping
2022-10-06T11:08:03Z [DEBUG] [/server/middleware/log/log.go:30]: attach request id 208a0d58-f14e-47a5-9ab2-cf1a9cbba71b to the logger for the request GET /api/v2.0/ping
2022-10-06T11:08:03Z [DEBUG] [/server/middleware/artifactinfo/artifact_info.go:54]: In artifact info middleware, url: /api/v2.0/ping
2022-10-06T11:08:03Z [DEBUG] [/server/middleware/security/unauthorized.go:28][requestID="208a0d58-f14e-47a5-9ab2-cf1a9cbba71b"]: an unauthorized security context generated for request GET /api/v2.0/ping
2022-10-06T11:08:08Z [DEBUG] [/server/middleware/log/log.go:30]: attach request id 2f5500fd4b3a7e2e7413bc2e6c27ecb4 to the logger for the request HEAD /v2/devops/nginx/blobs/sha256:fe24ce36f968b9315f7713fee767d50444dea2b59951f171054cb4e3c12d4b81
2022-10-06T11:08:08Z [DEBUG] [/server/middleware/artifactinfo/artifact_info.go:54]: In artifact info middleware, url: /v2/devops/nginx/blobs/sha256:fe24ce36f968b9315f7713fee767d50444dea2b59951f171054cb4e3c12d4b81
2022-10-06T11:08:08Z [DEBUG] [/server/middleware/log/log.go:30]: attach request id 75bb3b9a5ba2fd23ff2f6b3e8472a193 to the logger for the request HEAD /v2/devops/nginx/blobs/sha256:6ab6a6301bdeddbcd0e6193262b2c54740f4ea12640c81c951223cdd5ec842a3
2022-10-06T11:08:08Z [DEBUG] [/server/middleware/artifactinfo/artifact_info.go:54]: In artifact info middleware, url: /v2/devops/nginx/blobs/sha256:6ab6a6301bdeddbcd0e6193262b2c54740f4ea12640c81c951223cdd5ec842a3
2022-10-06T11:08:08Z [DEBUG] [/server/middleware/log/log.go:30]: attach request id b8745a8b-4ac9-43ca-a43b-1995dddecc38 to the logger for the request GET /api/v2.0/ping
2022-10-06T11:08:08Z [DEBUG] [/server/middleware/artifactinfo/artifact_info.go:54]: In artifact info middleware, url: /api/v2.0/ping
2022-10-06T11:08:08Z [DEBUG] [/server/middleware/security/unauthorized.go:28][requestID="b8745a8b-4ac9-43ca-a43b-1995dddecc38"]: an unauthorized security context generated for request GET /api/v2.0/ping
2022-10-06T11:08:13Z [DEBUG] [/server/middleware/log/log.go:30]: attach request id 0c061b84-1ce2-4846-97db-22378b0073c2 to the logger for the request GET /api/v2.0/ping
2022-10-06T11:08:13Z [DEBUG] [/server/middleware/artifactinfo/artifact_info.go:54]: In artifact info middleware, url: /api/v2.0/ping
2022-10-06T11:08:13Z [DEBUG] [/server/middleware/security/unauthorized.go:28][requestID="0c061b84-1ce2-4846-97db-22378b0073c2"]: an unauthorized security context generated for request GET /api/v2.0/ping

Registry:

10.130.20.20 - - [06/Oct/2022:11:11:58 +0000] "GET / HTTP/1.1" 200 0 "" "kube-probe/1.20"
192.168.95.123 - - [06/Oct/2022:11:11:54 +0000] "PATCH /v2/devops/nginx/blobs/uploads/c84d31bc-7f78-43c4-a130-0ad75dce7f30?_state=yk2T1zuHxcDoUypDJhp4ucxydHdr40RZzah-1CXbVf57Ik5hbWUiOiJkZXZvcHMvbmdpbngiLCJVVUlEIjoiYzg0ZDMxYmMtN2Y3OC00M2M0LWExMzAtMGFkNzVkY2U3ZjMwIiwiT2Zmc2V0IjowLCJTdGFydGVkQXQiOiIyMDIyLTEwLTA2VDExOjExOjUyLjc0NjEyMTc2WiJ9 HTTP/1.1" 202 0 "" "docker/20.10.18 go/go1.18.6 git-commit/e42327a kernel/5.15.0-48-generic os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.18 \\(linux\\))"
time="2022-10-06T11:11:58.315656036Z" level=info msg="response completed" go.version=go1.18.5 http.request.host=harbor.example.com http.request.id=70db6d7f-e86c-4198-a71a-446d46541ef0 http.request.method=PATCH http.request.remoteaddr=10.128.251.3 http.request.uri="/v2/devops/nginx/blobs/uploads/c84d31bc-7f78-43c4-a130-0ad75dce7f30?_state=yk2T1zuHxcDoUypDJhp4ucxydHdr40RZzah-1CXbVf57Ik5hbWUiOiJkZXZvcHMvbmdpbngiLCJVVUlEIjoiYzg0ZDMxYmMtN2Y3OC00M2M0LWExMzAtMGFkNzVkY2U3ZjMwIiwiT2Zmc2V0IjowLCJTdGFydGVkQXQiOiIyMDIyLTEwLTA2VDExOjExOjUyLjc0NjEyMTc2WiJ9" http.request.useragent="docker/20.10.18 go/go1.18.6 git-commit/e42327a kernel/5.15.0-48-generic os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.18 \(linux\))" http.response.duration=3.682161422s http.response.status=202 http.response.written=0 
time="2022-10-06T11:11:58.422315834Z" level=info msg="authorized request" go.version=go1.18.5 http.request.host=harbor.example.com http.request.id=7be3badf-2ed0-4246-aac8-f243c6450260 http.request.method=PUT http.request.remoteaddr=10.128.251.3 http.request.uri="/v2/devops/nginx/blobs/uploads/77304f7e-23a3-44f9-8aca-4ae1ad62cfdb?_state=_pm5XKhZr3T4ADCMelDolVZ6MRih5SP5lmbPixSY2097Ik5hbWUiOiJkZXZvcHMvbmdpbngiLCJVVUlEIjoiNzczMDRmN2UtMjNhMy00NGY5LThhY2EtNGFlMWFkNjJjZmRiIiwiT2Zmc2V0Ijo2MDIsIlN0YXJ0ZWRBdCI6IjIwMjItMTAtMDZUMTE6MTE6NTJaIn0%3D&digest=sha256%3A98b0bbcc0ec67f3b41dc3140ee2fe804d410548392307a2c6d4f9921ea30261f" http.request.useragent="docker/20.10.18 go/go1.18.6 git-commit/e42327a kernel/5.15.0-48-generic os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.18 \(linux\))" vars.name="devops/nginx" vars.uuid=77304f7e-23a3-44f9-8aca-4ae1ad62cfdb 
time="2022-10-06T11:11:59.047366476Z" level=info msg="authorized request" go.version=go1.18.5 http.request.host=harbor.example.com http.request.id=c9452712-65aa-42d2-8a6d-626e47bdb3e7 http.request.method=PUT http.request.remoteaddr=10.128.251.3 http.request.uri="/v2/devops/nginx/blobs/uploads/c84d31bc-7f78-43c4-a130-0ad75dce7f30?_state=scP2uLY3i0AsjItrettcqmni-CAMY0sQB6675X0aJe97Ik5hbWUiOiJkZXZvcHMvbmdpbngiLCJVVUlEIjoiYzg0ZDMxYmMtN2Y3OC00M2M0LWExMzAtMGFkNzVkY2U3ZjMwIiwiT2Zmc2V0Ijo2NjUsIlN0YXJ0ZWRBdCI6IjIwMjItMTAtMDZUMTE6MTE6NTJaIn0%3D&digest=sha256%3Af5d8edcd47b1b04e279cc2414cad5c38b423d1d5ee9801ca7c81ef63d0941c98" http.request.useragent="docker/20.10.18 go/go1.18.6 git-commit/e42327a kernel/5.15.0-48-generic os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.18 \(linux\))" vars.name="devops/nginx" vars.uuid=c84d31bc-7f78-43c4-a130-0ad75dce7f30 
10.130.20.168 - - [06/Oct/2022:11:11:59 +0000] "GET / HTTP/1.1" 200 0 "" "kube-probe/1.20"
time="2022-10-06T11:11:59.296194645Z" level=info msg="authorized request" go.version=go1.18.5 http.request.host=harbor.example.com http.request.id=e30d642b-7590-4fcf-9da5-d7e5ae6f072d http.request.method=POST http.request.remoteaddr=10.128.251.3 http.request.uri="/v2/devops/nginx/blobs/uploads/" http.request.useragent="docker/20.10.18 go/go1.18.6 git-commit/e42327a kernel/5.15.0-48-generic os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.18 \(linux\))" vars.name="devops/nginx" 
time="2022-10-06T11:12:00.386901352Z" level=info msg="response completed" go.version=go1.18.5 http.request.host=harbor.example.com http.request.id=3d9d7e50-2169-4992-b794-db3578d7477c http.request.method=PATCH http.request.remoteaddr=10.128.251.3 http.request.uri="/v2/devops/nginx/blobs/uploads/cfb693bb-b3db-49bc-bd0b-49a503e1aaa5?_state=L1Tql8IlW15UllMeHoz23ELpVcUdAQh-Dfm0y-qjUIl7Ik5hbWUiOiJkZXZvcHMvbmdpbngiLCJVVUlEIjoiY2ZiNjkzYmItYjNkYi00OWJjLWJkMGItNDlhNTAzZTFhYWE1IiwiT2Zmc2V0IjowLCJTdGFydGVkQXQiOiIyMDIyLTEwLTA2VDExOjExOjU0LjUxOTU2MjgwMVoifQ%3D%3D" http.request.useragent="docker/20.10.18 go/go1.18.6 git-commit/e42327a kernel/5.15.0-48-generic os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.18 \(linux\))" http.response.duration=3.706097s http.response.status=202 http.response.written=0 
192.168.76.148 - - [06/Oct/2022:11:11:56 +0000] "PATCH /v2/devops/nginx/blobs/uploads/cfb693bb-b3db-49bc-bd0b-49a503e1aaa5?_state=L1Tql8IlW15UllMeHoz23ELpVcUdAQh-Dfm0y-qjUIl7Ik5hbWUiOiJkZXZvcHMvbmdpbngiLCJVVUlEIjoiY2ZiNjkzYmItYjNkYi00OWJjLWJkMGItNDlhNTAzZTFhYWE1IiwiT2Zmc2V0IjowLCJTdGFydGVkQXQiOiIyMDIyLTEwLTA2VDExOjExOjU0LjUxOTU2MjgwMVoifQ%3D%3D HTTP/1.1" 202 0 "" "docker/20.10.18 go/go1.18.6 git-commit/e42327a kernel/5.15.0-48-generic os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.18 \\(linux\\))"
192.168.76.148 - - [06/Oct/2022:11:11:59 +0000] "POST /v2/devops/nginx/blobs/uploads/ HTTP/1.1" 202 0 "" "docker/20.10.18 go/go1.18.6 git-commit/e42327a kernel/5.15.0-48-generic os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.18 \\(linux\\))"
time="2022-10-06T11:12:00.898318788Z" level=info msg="response completed" go.version=go1.18.5 http.request.host=harbor.example.com http.request.id=e30d642b-7590-4fcf-9da5-d7e5ae6f072d http.request.method=POST http.request.remoteaddr=10.128.251.3 http.request.uri="/v2/devops/nginx/blobs/uploads/" http.request.useragent="docker/20.10.18 go/go1.18.6 git-commit/e42327a kernel/5.15.0-48-generic os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.18 \(linux\))" http.response.duration=1.737016813s http.response.status=202 http.response.written=0 
10.130.20.168 - - [06/Oct/2022:11:12:07 +0000] "GET / HTTP/1.1" 200 0 "" "kube-probe/1.20"
time="2022-10-06T11:12:00.514941819Z" level=info msg="response completed" go.version=go1.18.5 http.request.host=harbor.example.com http.request.id=d226b21a-7543-4f84-81c2-9f3d335d3600 http.request.method=PATCH http.request.remoteaddr=10.128.251.3 http.request.uri="/v2/devops/nginx/blobs/uploads/efa568bf-3bd0-4576-9805-94989700a416?_state=f-17rQIfyjU31O7_j9ODHY11onqQ-JKdABdnJxcnD1l7Ik5hbWUiOiJkZXZvcHMvbmdpbngiLCJVVUlEIjoiZWZhNTY4YmYtM2JkMC00NTc2LTk4MDUtOTQ5ODk3MDBhNDE2IiwiT2Zmc2V0IjowLCJTdGFydGVkQXQiOiIyMDIyLTEwLTA2VDExOjExOjU0LjYyMDEyOTAwNFoifQ%3D%3D" http.request.useragent="docker/20.10.18 go/go1.18.6 git-commit/e42327a kernel/5.15.0-48-generic os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.18 \(linux\))" http.response.duration=3.819427739s http.response.status=202 http.response.written=0 
192.168.95.123 - - [06/Oct/2022:11:11:56 +0000] "PATCH /v2/devops/nginx/blobs/uploads/efa568bf-3bd0-4576-9805-94989700a416?_state=f-17rQIfyjU31O7_j9ODHY11onqQ-JKdABdnJxcnD1l7Ik5hbWUiOiJkZXZvcHMvbmdpbngiLCJVVUlEIjoiZWZhNTY4YmYtM2JkMC00NTc2LTk4MDUtOTQ5ODk3MDBhNDE2IiwiT2Zmc2V0IjowLCJTdGFydGVkQXQiOiIyMDIyLTEwLTA2VDExOjExOjU0LjYyMDEyOTAwNFoifQ%3D%3D HTTP/1.1" 202 0 "" "docker/20.10.18 go/go1.18.6 git-commit/e42327a kernel/5.15.0-48-generic os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.18 \\(linux\\))"
10.130.20.20 - - [06/Oct/2022:11:12:03 +0000] "GET / HTTP/1.1" 200 0 "" "kube-probe/1.20"
192.168.95.123 - - [06/Oct/2022:11:12:04 +0000] "GET / HTTP/1.1" 200 0 "" "Go-http-client/1.1"
192.168.76.148 - - [06/Oct/2022:11:12:06 +0000] "GET / HTTP/1.1" 200 0 "" "Go-http-client/1.1"
192.168.76.148 - - [06/Oct/2022:11:11:58 +0000] "PUT /v2/devops/nginx/blobs/uploads/77304f7e-23a3-44f9-8aca-4ae1ad62cfdb?_state=_pm5XKhZr3T4ADCMelDolVZ6MRih5SP5lmbPixSY2097Ik5hbWUiOiJkZXZvcHMvbmdpbngiLCJVVUlEIjoiNzczMDRmN2UtMjNhMy00NGY5LThhY2EtNGFlMWFkNjJjZmRiIiwiT2Zmc2V0Ijo2MDIsIlN0YXJ0ZWRBdCI6IjIwMjItMTAtMDZUMTE6MTE6NTJaIn0%3D&digest=sha256%3A98b0bbcc0ec67f3b41dc3140ee2fe804d410548392307a2c6d4f9921ea30261f HTTP/1.1" 201 0 "" "docker/20.10.18 go/go1.18.6 git-commit/e42327a kernel/5.15.0-48-generic os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.18 \\(linux\\))"
10.130.20.20 - - [06/Oct/2022:11:12:08 +0000] "GET / HTTP/1.1" 200 0 "" "kube-probe/1.20"
time="2022-10-06T11:12:08.917559792Z" level=info msg="response completed" go.version=go1.18.5 http.request.host=harbor.example.com http.request.id=7be3badf-2ed0-4246-aac8-f243c6450260 http.request.method=PUT http.request.remoteaddr=10.128.251.3 http.request.uri="/v2/devops/nginx/blobs/uploads/77304f7e-23a3-44f9-8aca-4ae1ad62cfdb?_state=_pm5XKhZr3T4ADCMelDolVZ6MRih5SP5lmbPixSY2097Ik5hbWUiOiJkZXZvcHMvbmdpbngiLCJVVUlEIjoiNzczMDRmN2UtMjNhMy00NGY5LThhY2EtNGFlMWFkNjJjZmRiIiwiT2Zmc2V0Ijo2MDIsIlN0YXJ0ZWRBdCI6IjIwMjItMTAtMDZUMTE6MTE6NTJaIn0%3D&digest=sha256%3A98b0bbcc0ec67f3b41dc3140ee2fe804d410548392307a2c6d4f9921ea30261f" http.request.useragent="docker/20.10.18 go/go1.18.6 git-commit/e42327a kernel/5.15.0-48-generic os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.18 \(linux\))" http.response.duration=10.575001869s http.response.status=201 http.response.written=0 
10.130.20.168 - - [06/Oct/2022:11:12:09 +0000] "GET / HTTP/1.1" 200 0 "" "kube-probe/1.20"
192.168.95.123 - - [06/Oct/2022:11:11:58 +0000] "PUT /v2/devops/nginx/blobs/uploads/c84d31bc-7f78-43c4-a130-0ad75dce7f30?_state=scP2uLY3i0AsjItrettcqmni-CAMY0sQB6675X0aJe97Ik5hbWUiOiJkZXZvcHMvbmdpbngiLCJVVUlEIjoiYzg0ZDMxYmMtN2Y3OC00M2M0LWExMzAtMGFkNzVkY2U3ZjMwIiwiT2Zmc2V0Ijo2NjUsIlN0YXJ0ZWRBdCI6IjIwMjItMTAtMDZUMTE6MTE6NTJaIn0%3D&digest=sha256%3Af5d8edcd47b1b04e279cc2414cad5c38b423d1d5ee9801ca7c81ef63d0941c98 HTTP/1.1" 201 0 "" "docker/20.10.18 go/go1.18.6 git-commit/e42327a kernel/5.15.0-48-generic os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.18 \\(linux\\))"
time="2022-10-06T11:12:09.585653216Z" level=info msg="response completed" go.version=go1.18.5 http.request.host=harbor.example.com http.request.id=c9452712-65aa-42d2-8a6d-626e47bdb3e7 http.request.method=PUT http.request.remoteaddr=10.128.251.3 http.request.uri="/v2/devops/nginx/blobs/uploads/c84d31bc-7f78-43c4-a130-0ad75dce7f30?_state=scP2uLY3i0AsjItrettcqmni-CAMY0sQB6675X0aJe97Ik5hbWUiOiJkZXZvcHMvbmdpbngiLCJVVUlEIjoiYzg0ZDMxYmMtN2Y3OC00M2M0LWExMzAtMGFkNzVkY2U3ZjMwIiwiT2Zmc2V0Ijo2NjUsIlN0YXJ0ZWRBdCI6IjIwMjItMTAtMDZUMTE6MTE6NTJaIn0%3D&digest=sha256%3Af5d8edcd47b1b04e279cc2414cad5c38b423d1d5ee9801ca7c81ef63d0941c98" http.request.useragent="docker/20.10.18 go/go1.18.6 git-commit/e42327a kernel/5.15.0-48-generic os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.18 \(linux\))" http.response.duration=10.629636767s http.response.status=201 http.response.written=0 
time="2022-10-06T11:12:10.94085331Z" level=info msg="authorized request" go.version=go1.18.5 http.request.host=harbor.example.com http.request.id=292db2f0-4557-484f-8e12-f54b87c517c0 http.request.method=PUT http.request.remoteaddr=10.128.251.3 http.request.uri="/v2/devops/nginx/blobs/uploads/cfb693bb-b3db-49bc-bd0b-49a503e1aaa5?_state=IXCTQsFma72DWfTeSgXUWGnN6EuFJLukgl-aY3Dc7TV7Ik5hbWUiOiJkZXZvcHMvbmdpbngiLCJVVUlEIjoiY2ZiNjkzYmItYjNkYi00OWJjLWJkMGItNDlhNTAzZTFhYWE1IiwiT2Zmc2V0IjoxMzk0LCJTdGFydGVkQXQiOiIyMDIyLTEwLTA2VDExOjExOjU0WiJ9&digest=sha256%3Afe24ce36f968b9315f7713fee767d50444dea2b59951f171054cb4e3c12d4b81" http.request.useragent="docker/20.10.18 go/go1.18.6 git-commit/e42327a kernel/5.15.0-48-generic os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.18 \(linux\))" vars.name="devops/nginx" vars.uuid=cfb693bb-b3db-49bc-bd0b-49a503e1aaa5 
time="2022-10-06T11:12:12.297849602Z" level=info msg="authorized request" go.version=go1.18.5 http.request.host=harbor.example.com http.request.id=05063d3a-d687-4999-a137-5a1deefc38b2 http.request.method=HEAD http.request.remoteaddr=10.128.251.3 http.request.uri="/v2/devops/nginx/blobs/sha256:f5d8edcd47b1b04e279cc2414cad5c38b423d1d5ee9801ca7c81ef63d0941c98" http.request.useragent="docker/20.10.18 go/go1.18.6 git-commit/e42327a kernel/5.15.0-48-generic os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.18 \(linux\))" vars.digest="sha256:f5d8edcd47b1b04e279cc2414cad5c38b423d1d5ee9801ca7c81ef63d0941c98" vars.name="devops/nginx" 
time="2022-10-06T11:12:12.302387672Z" level=info msg="response completed" go.version=go1.18.5 http.request.host=harbor.example.com http.request.id=05063d3a-d687-4999-a137-5a1deefc38b2 http.request.method=HEAD http.request.remoteaddr=10.128.251.3 http.request.uri="/v2/devops/nginx/blobs/sha256:f5d8edcd47b1b04e279cc2414cad5c38b423d1d5ee9801ca7c81ef63d0941c98" http.request.useragent="docker/20.10.18 go/go1.18.6 git-commit/e42327a kernel/5.15.0-48-generic os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.18 \(linux\))" http.response.contenttype="application/octet-stream" http.response.duration=138.182257ms http.response.status=307 http.response.written=0 
192.168.76.148 - - [06/Oct/2022:11:12:12 +0000] "HEAD /v2/devops/nginx/blobs/sha256:f5d8edcd47b1b04e279cc2414cad5c38b423d1d5ee9801ca7c81ef63d0941c98 HTTP/1.1" 307 0 "" "docker/20.10.18 go/go1.18.6 git-commit/e42327a kernel/5.15.0-48-generic os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.18 \\(linux\\))"
10.130.20.20 - - [06/Oct/2022:11:12:13 +0000] "GET / HTTP/1.1" 200 0 "" "kube-probe/1.20"
192.168.95.123 - - [06/Oct/2022:11:12:14 +0000] "GET / HTTP/1.1" 200 0 "" "Go-http-client/1.1"
192.168.76.148 - - [06/Oct/2022:11:12:16 +0000] "GET / HTTP/1.1" 200 0 "" "Go-http-client/1.1"
10.130.20.168 - - [06/Oct/2022:11:12:17 +0000] "GET / HTTP/1.1" 200 0 "" "kube-probe/1.20"
10.130.20.20 - - [06/Oct/2022:11:12:18 +0000] "GET / HTTP/1.1" 200 0 "" "kube-probe/1.20"
10.130.20.168 - - [06/Oct/2022:11:12:19 +0000] "GET / HTTP/1.1" 200 0 "" "kube-probe/1.20"
time="2022-10-06T11:12:21.507855919Z" level=info msg="response completed" go.version=go1.18.5 http.request.host=harbor.example.com http.request.id=292db2f0-4557-484f-8e12-f54b87c517c0 http.request.method=PUT http.request.remoteaddr=10.128.251.3 http.request.uri="/v2/devops/nginx/blobs/uploads/cfb693bb-b3db-49bc-bd0b-49a503e1aaa5?_state=IXCTQsFma72DWfTeSgXUWGnN6EuFJLukgl-aY3Dc7TV7Ik5hbWUiOiJkZXZvcHMvbmdpbngiLCJVVUlEIjoiY2ZiNjkzYmItYjNkYi00OWJjLWJkMGItNDlhNTAzZTFhYWE1IiwiT2Zmc2V0IjoxMzk0LCJTdGFydGVkQXQiOiIyMDIyLTEwLTA2VDExOjExOjU0WiJ9&digest=sha256%3Afe24ce36f968b9315f7713fee767d50444dea2b59951f171054cb4e3c12d4b81" http.request.useragent="docker/20.10.18 go/go1.18.6 git-commit/e42327a kernel/5.15.0-48-generic os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.18 \(linux\))" http.response.duration=10.696224456s http.response.status=201 http.response.written=0 
192.168.95.123 - - [06/Oct/2022:11:12:10 +0000] "PUT /v2/devops/nginx/blobs/uploads/cfb693bb-b3db-49bc-bd0b-49a503e1aaa5?_state=IXCTQsFma72DWfTeSgXUWGnN6EuFJLukgl-aY3Dc7TV7Ik5hbWUiOiJkZXZvcHMvbmdpbngiLCJVVUlEIjoiY2ZiNjkzYmItYjNkYi00OWJjLWJkMGItNDlhNTAzZTFhYWE1IiwiT2Zmc2V0IjoxMzk0LCJTdGFydGVkQXQiOiIyMDIyLTEwLTA2VDExOjExOjU0WiJ9&digest=sha256%3Afe24ce36f968b9315f7713fee767d50444dea2b59951f171054cb4e3c12d4b81 HTTP/1.1" 201 0 "" "docker/20.10.18 go/go1.18.6 git-commit/e42327a kernel/5.15.0-48-generic os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.18 \\(linux\\))"
time="2022-10-06T11:12:23.421436742Z" level=info msg="authorized request" go.version=go1.18.5 http.request.host=harbor.example.com http.request.id=e28f2244-72e0-4302-b4d2-5d91e700d012 http.request.method=PUT http.request.remoteaddr=10.128.251.3 http.request.uri="/v2/devops/nginx/blobs/uploads/efa568bf-3bd0-4576-9805-94989700a416?_state=0S6ps0G2y8bP1lLbXIlbNTn5K3p_GWR1ghY74iPAsDx7Ik5hbWUiOiJkZXZvcHMvbmdpbngiLCJVVUlEIjoiZWZhNTY4YmYtM2JkMC00NTc2LTk4MDUtOTQ5ODk3MDBhNDE2IiwiT2Zmc2V0Ijo4OTMsIlN0YXJ0ZWRBdCI6IjIwMjItMTAtMDZUMTE6MTE6NTRaIn0%3D&digest=sha256%3A6ab6a6301bdeddbcd0e6193262b2c54740f4ea12640c81c951223cdd5ec842a3" http.request.useragent="docker/20.10.18 go/go1.18.6 git-commit/e42327a kernel/5.15.0-48-generic os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.18 \(linux\))" vars.name="devops/nginx" vars.uuid=efa568bf-3bd0-4576-9805-94989700a416 
time="2022-10-06T11:12:23.427877013Z" level=info msg="authorized request" go.version=go1.18.5 http.request.host=harbor.example.com http.request.id=f47f8cee-885a-4290-a089-797265742793 http.request.method=HEAD http.request.remoteaddr=10.128.251.3 http.request.uri="/v2/devops/nginx/blobs/sha256:fe24ce36f968b9315f7713fee767d50444dea2b59951f171054cb4e3c12d4b81" http.request.useragent="docker/20.10.18 go/go1.18.6 git-commit/e42327a kernel/5.15.0-48-generic os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.18 \(linux\))" vars.digest="sha256:fe24ce36f968b9315f7713fee767d50444dea2b59951f171054cb4e3c12d4b81" vars.name="devops/nginx" 
time="2022-10-06T11:12:23.432312025Z" level=info msg="response completed" go.version=go1.18.5 http.request.host=harbor.example.com http.request.id=f47f8cee-885a-4290-a089-797265742793 http.request.method=HEAD http.request.remoteaddr=10.128.251.3 http.request.uri="/v2/devops/nginx/blobs/sha256:fe24ce36f968b9315f7713fee767d50444dea2b59951f171054cb4e3c12d4b81" http.request.useragent="docker/20.10.18 go/go1.18.6 git-commit/e42327a kernel/5.15.0-48-generic os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.18 \(linux\))" http.response.contenttype="application/octet-stream" http.response.duration=135.241644ms http.response.status=307 http.response.written=0 
192.168.95.123 - - [06/Oct/2022:11:12:23 +0000] "HEAD /v2/devops/nginx/blobs/sha256:fe24ce36f968b9315f7713fee767d50444dea2b59951f171054cb4e3c12d4b81 HTTP/1.1" 307 0 "" "docker/20.10.18 go/go1.18.6 git-commit/e42327a kernel/5.15.0-48-generic os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.18 \\(linux\\))"
10.130.20.20 - - [06/Oct/2022:11:12:23 +0000] "GET / HTTP/1.1" 200 0 "" "kube-probe/1.20"
time="2022-10-06T11:12:24.031178033Z" level=info msg="authorized request" go.version=go1.18.5 http.request.host=harbor.example.com http.request.id=76b09255-b9a5-487f-8c99-1c2e58a903fa http.request.method=POST http.request.remoteaddr=10.128.251.3 http.request.uri="/v2/devops/nginx/blobs/uploads/" http.request.useragent="docker/20.10.18 go/go1.18.6 git-commit/e42327a kernel/5.15.0-48-generic os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.18 \(linux\))" vars.name="devops/nginx" 
192.168.95.123 - - [06/Oct/2022:11:12:24 +0000] "GET / HTTP/1.1" 200 0 "" "Go-http-client/1.1"
192.168.95.123 - - [06/Oct/2022:11:12:23 +0000] "POST /v2/devops/nginx/blobs/uploads/ HTTP/1.1" 202 0 "" "docker/20.10.18 go/go1.18.6 git-commit/e42327a kernel/5.15.0-48-generic os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.18 \\(linux\\))"
time="2022-10-06T11:12:25.560526977Z" level=info msg="response completed" go.version=go1.18.5 http.request.host=harbor.example.com http.request.id=76b09255-b9a5-487f-8c99-1c2e58a903fa http.request.method=POST http.request.remoteaddr=10.128.251.3 http.request.uri="/v2/devops/nginx/blobs/uploads/" http.request.useragent="docker/20.10.18 go/go1.18.6 git-commit/e42327a kernel/5.15.0-48-generic os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.18 \(linux\))" http.response.duration=1.659144664s http.response.status=202 http.response.written=0 
192.168.76.148 - - [06/Oct/2022:11:12:26 +0000] "GET / HTTP/1.1" 200 0 "" "Go-http-client/1.1"
time="2022-10-06T11:12:27.641469848Z" level=info msg="authorized request" go.version=go1.18.5 http.request.host=harbor.example.com http.request.id=a127874b-a537-424d-acbc-b66c029c0fea http.request.method=HEAD http.request.remoteaddr=10.128.251.3 http.request.uri="/v2/devops/nginx/blobs/sha256:98b0bbcc0ec67f3b41dc3140ee2fe804d410548392307a2c6d4f9921ea30261f" http.request.useragent="docker/20.10.18 go/go1.18.6 git-commit/e42327a kernel/5.15.0-48-generic os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.18 \(linux\))" vars.digest="sha256:98b0bbcc0ec67f3b41dc3140ee2fe804d410548392307a2c6d4f9921ea30261f" vars.name="devops/nginx" 
10.130.20.168 - - [06/Oct/2022:11:12:27 +0000] "GET / HTTP/1.1" 200 0 "" "kube-probe/1.20"
192.168.76.148 - - [06/Oct/2022:11:12:27 +0000] "HEAD /v2/devops/nginx/blobs/sha256:98b0bbcc0ec67f3b41dc3140ee2fe804d410548392307a2c6d4f9921ea30261f HTTP/1.1" 307 0 "" "docker/20.10.18 go/go1.18.6 git-commit/e42327a kernel/5.15.0-48-generic os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.18 \\(linux\\))"
time="2022-10-06T11:12:27.647159391Z" level=info msg="response completed" go.version=go1.18.5 http.request.host=harbor.example.com http.request.id=a127874b-a537-424d-acbc-b66c029c0fea http.request.method=HEAD http.request.remoteaddr=10.128.251.3 http.request.uri="/v2/devops/nginx/blobs/sha256:98b0bbcc0ec67f3b41dc3140ee2fe804d410548392307a2c6d4f9921ea30261f" http.request.useragent="docker/20.10.18 go/go1.18.6 git-commit/e42327a kernel/5.15.0-48-generic os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.18 \(linux\))" http.response.contenttype="application/octet-stream" http.response.duration=131.191973ms http.response.status=307 http.response.written=0 
10.130.20.20 - - [06/Oct/2022:11:12:28 +0000] "GET / HTTP/1.1" 200 0 "" "kube-probe/1.20"
10.130.20.168 - - [06/Oct/2022:11:12:29 +0000] "GET / HTTP/1.1" 200 0 "" "kube-probe/1.20"
10.130.20.20 - - [06/Oct/2022:11:12:33 +0000] "GET / HTTP/1.1" 200 0 "" "kube-probe/1.20"
time="2022-10-06T11:12:33.833280988Z" level=info msg="response completed" go.version=go1.18.5 http.request.host=harbor.example.com http.request.id=e28f2244-72e0-4302-b4d2-5d91e700d012 http.request.method=PUT http.request.remoteaddr=10.128.251.3 http.request.uri="/v2/devops/nginx/blobs/uploads/efa568bf-3bd0-4576-9805-94989700a416?_state=0S6ps0G2y8bP1lLbXIlbNTn5K3p_GWR1ghY74iPAsDx7Ik5hbWUiOiJkZXZvcHMvbmdpbngiLCJVVUlEIjoiZWZhNTY4YmYtM2JkMC00NTc2LTk4MDUtOTQ5ODk3MDBhNDE2IiwiT2Zmc2V0Ijo4OTMsIlN0YXJ0ZWRBdCI6IjIwMjItMTAtMDZUMTE6MTE6NTRaIn0%3D&digest=sha256%3A6ab6a6301bdeddbcd0e6193262b2c54740f4ea12640c81c951223cdd5ec842a3" http.request.useragent="docker/20.10.18 go/go1.18.6 git-commit/e42327a kernel/5.15.0-48-generic os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.18 \(linux\))" http.response.duration=10.524134376s http.response.status=201 http.response.written=0 
192.168.76.148 - - [06/Oct/2022:11:12:23 +0000] "PUT /v2/devops/nginx/blobs/uploads/efa568bf-3bd0-4576-9805-94989700a416?_state=0S6ps0G2y8bP1lLbXIlbNTn5K3p_GWR1ghY74iPAsDx7Ik5hbWUiOiJkZXZvcHMvbmdpbngiLCJVVUlEIjoiZWZhNTY4YmYtM2JkMC00NTc2LTk4MDUtOTQ5ODk3MDBhNDE2IiwiT2Zmc2V0Ijo4OTMsIlN0YXJ0ZWRBdCI6IjIwMjItMTAtMDZUMTE6MTE6NTRaIn0%3D&digest=sha256%3A6ab6a6301bdeddbcd0e6193262b2c54740f4ea12640c81c951223cdd5ec842a3 HTTP/1.1" 201 0 "" "docker/20.10.18 go/go1.18.6 git-commit/e42327a kernel/5.15.0-48-generic os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.18 \\(linux\\))"
192.168.95.123 - - [06/Oct/2022:11:12:34 +0000] "GET / HTTP/1.1" 200 0 "" "Go-http-client/1.1"
192.168.76.148 - - [06/Oct/2022:11:12:36 +0000] "GET / HTTP/1.1" 200 0 "" "Go-http-client/1.1"
time="2022-10-06T11:12:37.140066253Z" level=info msg="authorized request" go.version=go1.18.5 http.request.host=harbor.example.com http.request.id=64bf7189-88f9-442f-9354-b0b6efa8d895 http.request.method=HEAD http.request.remoteaddr=10.128.251.3 http.request.uri="/v2/devops/nginx/blobs/sha256:6ab6a6301bdeddbcd0e6193262b2c54740f4ea12640c81c951223cdd5ec842a3" http.request.useragent="docker/20.10.18 go/go1.18.6 git-commit/e42327a kernel/5.15.0-48-generic os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.18 \(linux\))" vars.digest="sha256:6ab6a6301bdeddbcd0e6193262b2c54740f4ea12640c81c951223cdd5ec842a3" vars.name="devops/nginx" 
192.168.95.123 - - [06/Oct/2022:11:12:37 +0000] "HEAD /v2/devops/nginx/blobs/sha256:6ab6a6301bdeddbcd0e6193262b2c54740f4ea12640c81c951223cdd5ec842a3 HTTP/1.1" 307 0 "" "docker/20.10.18 go/go1.18.6 git-commit/e42327a kernel/5.15.0-48-generic os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.18 \\(linux\\))"
time="2022-10-06T11:12:37.150801893Z" level=info msg="response completed" go.version=go1.18.5 http.request.host=harbor.example.com http.request.id=64bf7189-88f9-442f-9354-b0b6efa8d895 http.request.method=HEAD http.request.remoteaddr=10.128.251.3 http.request.uri="/v2/devops/nginx/blobs/sha256:6ab6a6301bdeddbcd0e6193262b2c54740f4ea12640c81c951223cdd5ec842a3" http.request.useragent="docker/20.10.18 go/go1.18.6 git-commit/e42327a kernel/5.15.0-48-generic os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.18 \(linux\))" http.response.contenttype="application/octet-stream" http.response.duration=93.525739ms http.response.status=307 http.response.written=0

Thanks for the help & support!

Oct 10 '22 08:10 Kanshiroron

I'm not sure if it's a workaround or the correct configuration but setting persistence.imageChartStorage.disableredirect to true fixed my issue. My best assumption is that this was caused because our Swift endpoint is signed by a self-signed certificate that was not recognize by my local Docker cli. ? If that is the case, might be worth adding a comment to the configuration?

https://github.com/distribution/distribution/issues/1397

Thanks!

Oct 11 '22 14:10 Kanshiroron

@zyyw you closed the issue but I'm not sure anything has been done on Harbor side. Don't we want t enhance the documentation or rename the variable? Or open a bug on the Swift client?

Oct 24 '22 12:10 Kanshiroron

harbor-helm harbor-helm copied to clipboard

[Harbor 2.6.0 / Swift] Fails to finilize image push

harbor-helm
harbor-helm copied to clipboard