ocis-charts icon indicating copy to clipboard operation
ocis-charts copied to clipboard
verified publisher icon owncloud

chunked upload fails on with oCIS 6

Open wkloucek opened this issue 1 year ago • 7 comments

I couldn't manage to upload larger files because they all end up with 502 Bad Gateway on the PATCH request that follows the first POST request when using chunked upload with TUS

cc @case0sh @dschmidt

wkloucek avatar Jul 15 '24 12:07 wkloucek

Just for curiosity: What are larger files? 500MB, 1GB?

d7oc avatar Jul 22 '24 09:07 d7oc

Just for curiosity: What are larger files?

In this case it was 56,3 MiB. Actually I can't recap the actual size where Web switches from single POST upload to chunked TUS upload.

wkloucek avatar Jul 23 '24 12:07 wkloucek

@micbar Is that some information you or your team can provide?

d7oc avatar Jul 23 '24 12:07 d7oc

The default is documented in the docs.

I think it is 10MB

micbar avatar Jul 23 '24 14:07 micbar

I think it is 10MB

Yes it is.

Funnily this is no problem on https://ocis.ocis.rolling.owncloud.works:

image

image

In Minikube, I get:

web-d695bd9c5-8cnzs web {"level":"debug","service":"web","request-id":"6fad360bf1a0bc3aeaa7c93e871b15fc","proto":"HTTP/1.1","method":"GET","status":200,"path":"/icons/close-fill.svg","duration":0.303973,"bytes":307,"time":"2024-07-23T14:48:56Z","line":"github.com/owncloud/ocis/v2/ocis-pkg/middleware/logger.go:27"}
proxy-6ffc94748-46z22 proxy {"level":"info","service":"proxy","proto":"HTTP/1.1","request-id":"6fad360bf1a0bc3aeaa7c93e871b15fc","traceid":"45d94ada8d179d761cbc6706a29b77dc","remote-addr":"192.168.49.1","method":"GET","status":200,"path":"/icons/close-fill.svg","duration":1.988773,"bytes":212,"time":"2024-07-23T14:48:56Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/middleware/accesslog.go:34","message":"access-log"}
proxy-6ffc94748-46z22 proxy {"level":"debug","service":"proxy","policy":"ocis","method":"HEAD","prefix":"/data","path":"/data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMyNDMxLCJpYXQiOjE3MjE3NDYwMzEsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy80NGNhOWMzNC0xNWQ0LTRkYzEtYjc1NS1kOTQ5ODY4NWVhZjEifQ.BXLeC56szzDL1BK0IPqP1yZ_-YzLxdp8ww5wgQVybEc","routeType":"prefix","time":"2024-07-23T14:48:56Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/router/router.go:224","message":"rewrite hook found"}
frontend-76488f8c76-2hxq5 frontend {"level":"info","service":"frontend","pkg":"rhttp","traceid":"4317436cf9a000c7be826abe63836b50","time":"2024-07-23T14:48:56Z","line":"github.com/cs3org/reva/[email protected]/internal/http/interceptors/auth/auth.go:195","message":"skipping auth check for: /data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMyNDMxLCJpYXQiOjE3MjE3NDYwMzEsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy80NGNhOWMzNC0xNWQ0LTRkYzEtYjc1NS1kOTQ5ODY4NWVhZjEifQ.BXLeC56szzDL1BK0IPqP1yZ_-YzLxdp8ww5wgQVybEc"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"info","service":"storage-users","pkg":"rhttp","traceid":"4c48868a45d46d88d85b9da0f3f9eefe","time":"2024-07-23T14:48:56Z","line":"github.com/cs3org/reva/[email protected]/internal/http/interceptors/auth/auth.go:195","message":"skipping auth check for: /data/tus/44ca9c34-15d4-4dc1-b755-d9498685eaf1"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"warn","service":"storage-users","pkg":"rhttp","traceid":"4c48868a45d46d88d85b9da0f3f9eefe","time":"2024-07-23T14:48:56Z","line":"github.com/cs3org/reva/[email protected]/internal/http/interceptors/auth/auth.go:248","message":"core access token not set"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"debug","service":"storage-users","pkg":"rhttp","time":"2024-07-23T14:48:56Z","line":"github.com/cs3org/reva/[email protected]/pkg/rhttp/rhttp.go:248","message":"http routing: head=data tail=/tus/44ca9c34-15d4-4dc1-b755-d9498685eaf1 svc=data"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"debug","service":"storage-users","pkg":"rhttp","traceid":"4c48868a45d46d88d85b9da0f3f9eefe","request-id":"1fe28dc0-16a6-4541-a419-44319f4942b8","time":"2024-07-23T14:48:56Z","line":"github.com/cs3org/reva/[email protected]/internal/http/services/dataprovider/dataprovider.go:179","message":"dataprovider routing: path=/tus/44ca9c34-15d4-4dc1-b755-d9498685eaf1"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"debug","service":"storage-users","pkg":"rhttp","traceid":"4c48868a45d46d88d85b9da0f3f9eefe","host":"10.244.6.246","method":"HEAD","uri":"/data/tus/44ca9c34-15d4-4dc1-b755-d9498685eaf1","url":"/44ca9c34-15d4-4dc1-b755-d9498685eaf1","proto":"HTTP/1.1","status":200,"size":0,"start":"23/Jul/2024:14:48:56 +0000","end":"23/Jul/2024:14:48:56 +0000","time_ns":1080119,"time":"2024-07-23T14:48:56Z","line":"github.com/cs3org/reva/[email protected]/internal/http/interceptors/log/log.go:112","message":"http"}
proxy-6ffc94748-46z22 proxy {"level":"info","service":"proxy","proto":"HTTP/1.1","request-id":"1fe28dc0-16a6-4541-a419-44319f4942b8","traceid":"34375759c6b4c13ac77a3d55b3f28bd4","remote-addr":"192.168.49.1","method":"HEAD","status":200,"path":"/data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMyNDMxLCJpYXQiOjE3MjE3NDYwMzEsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy80NGNhOWMzNC0xNWQ0LTRkYzEtYjc1NS1kOTQ5ODY4NWVhZjEifQ.BXLeC56szzDL1BK0IPqP1yZ_-YzLxdp8ww5wgQVybEc","duration":7.103947,"bytes":0,"time":"2024-07-23T14:48:56Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/middleware/accesslog.go:34","message":"access-log"}
frontend-76488f8c76-2hxq5 frontend {"level":"warn","service":"frontend","pkg":"rhttp","traceid":"4317436cf9a000c7be826abe63836b50","time":"2024-07-23T14:48:56Z","line":"github.com/cs3org/reva/[email protected]/internal/http/interceptors/auth/auth.go:248","message":"core access token not set"}
frontend-76488f8c76-2hxq5 frontend {"level":"debug","service":"frontend","pkg":"rhttp","time":"2024-07-23T14:48:56Z","line":"github.com/cs3org/reva/[email protected]/pkg/rhttp/rhttp.go:248","message":"http routing: head=data tail=/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMyNDMxLCJpYXQiOjE3MjE3NDYwMzEsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy80NGNhOWMzNC0xNWQ0LTRkYzEtYjc1NS1kOTQ5ODY4NWVhZjEifQ.BXLeC56szzDL1BK0IPqP1yZ_-YzLxdp8ww5wgQVybEc svc=data"}
frontend-76488f8c76-2hxq5 frontend {"level":"debug","service":"frontend","pkg":"rhttp","traceid":"4317436cf9a000c7be826abe63836b50","request-id":"1fe28dc0-16a6-4541-a419-44319f4942b8","target":"http://storageusers:9158/data/tus/44ca9c34-15d4-4dc1-b755-d9498685eaf1","time":"2024-07-23T14:48:56Z","line":"github.com/cs3org/reva/[email protected]/internal/http/services/datagateway/datagateway.go:187","message":"sending request to internal data server"}
frontend-76488f8c76-2hxq5 frontend {"level":"error","service":"frontend","pkg":"rhttp","traceid":"4317436cf9a000c7be826abe63836b50","request-id":"1fe28dc0-16a6-4541-a419-44319f4942b8","content-length":58994227,"transferred-bytes":0,"time":"2024-07-23T14:48:56Z","line":"github.com/cs3org/reva/[email protected]/internal/http/services/datagateway/datagateway.go:226","message":"content length vs transferred bytes mismatch"}
frontend-76488f8c76-2hxq5 frontend {"level":"debug","service":"frontend","pkg":"rhttp","traceid":"4317436cf9a000c7be826abe63836b50","host":"10.244.6.224","method":"HEAD","uri":"/data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMyNDMxLCJpYXQiOjE3MjE3NDYwMzEsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy80NGNhOWMzNC0xNWQ0LTRkYzEtYjc1NS1kOTQ5ODY4NWVhZjEifQ.BXLeC56szzDL1BK0IPqP1yZ_-YzLxdp8ww5wgQVybEc","url":"/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMyNDMxLCJpYXQiOjE3MjE3NDYwMzEsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy80NGNhOWMzNC0xNWQ0LTRkYzEtYjc1NS1kOTQ5ODY4NWVhZjEifQ.BXLeC56szzDL1BK0IPqP1yZ_-YzLxdp8ww5wgQVybEc","proto":"HTTP/1.1","status":200,"size":0,"start":"23/Jul/2024:14:48:56 +0000","end":"23/Jul/2024:14:48:56 +0000","time_ns":5523695,"time":"2024-07-23T14:48:56Z","line":"github.com/cs3org/reva/[email protected]/internal/http/interceptors/log/log.go:112","message":"http"}
web-d695bd9c5-8cnzs web {"level":"debug","service":"web","request-id":"34e4f193a8dea5d9eb67fbb379e26fe1","proto":"HTTP/1.1","method":"GET","status":200,"path":"/icons/pause-circle-line.svg","duration":0.257686,"bytes":356,"time":"2024-07-23T14:48:56Z","line":"github.com/owncloud/ocis/v2/ocis-pkg/middleware/logger.go:27"}
proxy-6ffc94748-46z22 proxy {"level":"info","service":"proxy","proto":"HTTP/1.1","request-id":"34e4f193a8dea5d9eb67fbb379e26fe1","traceid":"59d052c53f5d2167a3799d19fed33c5b","remote-addr":"192.168.49.1","method":"GET","status":200,"path":"/icons/pause-circle-line.svg","duration":1.802401,"bytes":231,"time":"2024-07-23T14:48:56Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/middleware/accesslog.go:34","message":"access-log"}
web-d695bd9c5-8cnzs web {"level":"debug","service":"web","request-id":"b3a1a9a3705e247a53f76b5a571c1123","proto":"HTTP/1.1","method":"GET","status":200,"path":"/icons/close-circle-line.svg","duration":0.252196,"bytes":508,"time":"2024-07-23T14:48:56Z","line":"github.com/owncloud/ocis/v2/ocis-pkg/middleware/logger.go:27"}
proxy-6ffc94748-46z22 proxy {"level":"info","service":"proxy","proto":"HTTP/1.1","request-id":"b3a1a9a3705e247a53f76b5a571c1123","traceid":"d53a2a1e3059372322ad4e139806f66f","remote-addr":"192.168.49.1","method":"GET","status":200,"path":"/icons/close-circle-line.svg","duration":2.440716,"bytes":271,"time":"2024-07-23T14:48:56Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/middleware/accesslog.go:34","message":"access-log"}
proxy-6ffc94748-46z22 proxy {"level":"debug","service":"proxy","policy":"ocis","method":"PATCH","prefix":"/data","path":"/data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMyNDMxLCJpYXQiOjE3MjE3NDYwMzEsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy80NGNhOWMzNC0xNWQ0LTRkYzEtYjc1NS1kOTQ5ODY4NWVhZjEifQ.BXLeC56szzDL1BK0IPqP1yZ_-YzLxdp8ww5wgQVybEc","routeType":"prefix","time":"2024-07-23T14:48:56Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/router/router.go:224","message":"rewrite hook found"}
frontend-76488f8c76-2hxq5 frontend {"level":"info","service":"frontend","pkg":"rhttp","traceid":"dfc09b54d8341344d9fb3b0bc8c53015","time":"2024-07-23T14:48:56Z","line":"github.com/cs3org/reva/[email protected]/internal/http/interceptors/auth/auth.go:195","message":"skipping auth check for: /data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMyNDMxLCJpYXQiOjE3MjE3NDYwMzEsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy80NGNhOWMzNC0xNWQ0LTRkYzEtYjc1NS1kOTQ5ODY4NWVhZjEifQ.BXLeC56szzDL1BK0IPqP1yZ_-YzLxdp8ww5wgQVybEc"}
frontend-76488f8c76-2hxq5 frontend {"level":"warn","service":"frontend","pkg":"rhttp","traceid":"dfc09b54d8341344d9fb3b0bc8c53015","time":"2024-07-23T14:48:56Z","line":"github.com/cs3org/reva/[email protected]/internal/http/interceptors/auth/auth.go:248","message":"core access token not set"}
frontend-76488f8c76-2hxq5 frontend {"level":"debug","service":"frontend","pkg":"rhttp","time":"2024-07-23T14:48:56Z","line":"github.com/cs3org/reva/[email protected]/pkg/rhttp/rhttp.go:248","message":"http routing: head=data tail=/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMyNDMxLCJpYXQiOjE3MjE3NDYwMzEsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy80NGNhOWMzNC0xNWQ0LTRkYzEtYjc1NS1kOTQ5ODY4NWVhZjEifQ.BXLeC56szzDL1BK0IPqP1yZ_-YzLxdp8ww5wgQVybEc svc=data"}
frontend-76488f8c76-2hxq5 frontend {"level":"debug","service":"frontend","pkg":"rhttp","traceid":"dfc09b54d8341344d9fb3b0bc8c53015","request-id":"1fe28dc0-16a6-4541-a419-44319f4942b8","target":"http://storageusers:9158/data/tus/44ca9c34-15d4-4dc1-b755-d9498685eaf1","time":"2024-07-23T14:48:56Z","line":"github.com/cs3org/reva/[email protected]/internal/http/services/datagateway/datagateway.go:187","message":"sending request to internal data server"}
frontend-76488f8c76-2hxq5 frontend {"level":"warn","service":"frontend","pkg":"rhttp","traceid":"dfc09b54d8341344d9fb3b0bc8c53015","host":"10.244.6.224","method":"PATCH","uri":"/data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMyNDMxLCJpYXQiOjE3MjE3NDYwMzEsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy80NGNhOWMzNC0xNWQ0LTRkYzEtYjc1NS1kOTQ5ODY4NWVhZjEifQ.BXLeC56szzDL1BK0IPqP1yZ_-YzLxdp8ww5wgQVybEc","url":"/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMyNDMxLCJpYXQiOjE3MjE3NDYwMzEsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy80NGNhOWMzNC0xNWQ0LTRkYzEtYjc1NS1kOTQ5ODY4NWVhZjEifQ.BXLeC56szzDL1BK0IPqP1yZ_-YzLxdp8ww5wgQVybEc","proto":"HTTP/1.1","status":403,"size":0,"start":"23/Jul/2024:14:48:56 +0000","end":"23/Jul/2024:14:48:56 +0000","time_ns":1879116,"time":"2024-07-23T14:48:56Z","line":"github.com/cs3org/reva/[email protected]/internal/http/interceptors/log/log.go:112","message":"http"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"info","service":"storage-users","pkg":"rhttp","traceid":"9bfa663e8c7445e8da2c14ee98e14d83","time":"2024-07-23T14:48:56Z","line":"github.com/cs3org/reva/[email protected]/internal/http/interceptors/auth/auth.go:195","message":"skipping auth check for: /data/tus/44ca9c34-15d4-4dc1-b755-d9498685eaf1"}
proxy-6ffc94748-46z22 proxy {"level":"info","service":"proxy","proto":"HTTP/1.1","request-id":"1fe28dc0-16a6-4541-a419-44319f4942b8","traceid":"7d2e4006dbd728c91397c31828aae348","remote-addr":"192.168.49.1","method":"PATCH","status":403,"path":"/data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMyNDMxLCJpYXQiOjE3MjE3NDYwMzEsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy80NGNhOWMzNC0xNWQ0LTRkYzEtYjc1NS1kOTQ5ODY4NWVhZjEifQ.BXLeC56szzDL1BK0IPqP1yZ_-YzLxdp8ww5wgQVybEc","duration":4.309202,"bytes":0,"time":"2024-07-23T14:48:56Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/middleware/accesslog.go:34","message":"access-log"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"warn","service":"storage-users","pkg":"rhttp","traceid":"9bfa663e8c7445e8da2c14ee98e14d83","time":"2024-07-23T14:48:56Z","line":"github.com/cs3org/reva/[email protected]/internal/http/interceptors/auth/auth.go:248","message":"core access token not set"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"debug","service":"storage-users","pkg":"rhttp","time":"2024-07-23T14:48:56Z","line":"github.com/cs3org/reva/[email protected]/pkg/rhttp/rhttp.go:248","message":"http routing: head=data tail=/tus/44ca9c34-15d4-4dc1-b755-d9498685eaf1 svc=data"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"debug","service":"storage-users","pkg":"rhttp","traceid":"9bfa663e8c7445e8da2c14ee98e14d83","request-id":"1fe28dc0-16a6-4541-a419-44319f4942b8","time":"2024-07-23T14:48:56Z","line":"github.com/cs3org/reva/[email protected]/internal/http/services/dataprovider/dataprovider.go:179","message":"dataprovider routing: path=/tus/44ca9c34-15d4-4dc1-b755-d9498685eaf1"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"warn","service":"storage-users","pkg":"rhttp","traceid":"9bfa663e8c7445e8da2c14ee98e14d83","host":"10.244.6.246","method":"PATCH","uri":"/data/tus/44ca9c34-15d4-4dc1-b755-d9498685eaf1","url":"/44ca9c34-15d4-4dc1-b755-d9498685eaf1","proto":"HTTP/1.1","status":403,"size":30,"start":"23/Jul/2024:14:48:56 +0000","end":"23/Jul/2024:14:48:56 +0000","time_ns":200929,"time":"2024-07-23T14:48:56Z","line":"github.com/cs3org/reva/[email protected]/internal/http/interceptors/log/log.go:112","message":"http"}
web-d695bd9c5-8cnzs web {"level":"debug","service":"web","request-id":"f07bd6512b941591b95f38f5019ca472","proto":"HTTP/1.1","method":"GET","status":200,"path":"/icons/restart-line.svg","duration":0.102794,"bytes":415,"time":"2024-07-23T14:48:56Z","line":"github.com/owncloud/ocis/v2/ocis-pkg/middleware/logger.go:27"}
proxy-6ffc94748-46z22 proxy {"level":"info","service":"proxy","proto":"HTTP/1.1","request-id":"f07bd6512b941591b95f38f5019ca472","traceid":"e886cb0faa40aa09a6f7488bbb799655","remote-addr":"192.168.49.1","method":"GET","status":200,"path":"/icons/restart-line.svg","duration":1.093804,"bytes":270,"time":"2024-07-23T14:48:56Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/middleware/accesslog.go:34","message":"access-log"}

image

image

For whatever reason I see on the continuous deployment:

  • POST followed by multiple PATCHES but on my Minikube installation:
  • HEAD followed by a failing PATCH

wkloucek avatar Jul 23 '24 15:07 wkloucek

Actually I need to test in Minikube with a file that I didn't upload before, than I also can see a POST before the patch:

image

image

The log for this case (but different file) looks like this:

proxy-6ffc94748-46z22 proxy {"level":"debug","service":"proxy","policy":"ocis","method":"POST","prefix":"/remote.php/","path":"/remote.php/dav/spaces/68008272-be27-419c-aac6-1775980e7769$81bc3848-677f-42af-abd8-405c6a79348c","routeType":"prefix","time":"2024-07-23T15:05:20Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/router/router.go:224","message":"rewrite hook found"}
proxy-6ffc94748-46z22 proxy {"level":"debug","service":"proxy","access token":{"sid":"","iss":"https://ocis.kube.owncloud.test","sub":"GaaC3LZ3ywA5_qTK@MH3-31PL7fRAXierXMCeuUVZ8JnkavLKaSnWgn2p_nKVbpOBi2xVstS8ALoseEG-kSehoQ","aud":["web"],"exp":1721747196,"iat":1721746896,"jti":"SCDlU6YO0J4c7XqDOmCjAtl73DM4FWVF"},"time":"2024-07-23T15:05:20Z","line":"github.com/owncloud/ocis/v2/ocis-pkg/oidc/client.go:305","message":"parsed access token"}
proxy-6ffc94748-46z22 proxy {"level":"debug","service":"proxy","policy":"ocis","method":"GET","prefix":"/konnect/","path":"/konnect/v1/userinfo","routeType":"prefix","time":"2024-07-23T15:05:20Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/router/router.go:224","message":"rewrite hook found"}
idm-5595968-vs7df idm {"level":"debug","service":"idm","addr":"{\"IP\":\"::\",\"Port\":9235,\"Zone\":\"\"}","time":"2024-07-23T15:05:20Z","line":"github.com/owncloud/ocis/v2/ocis-pkg/log/logrus_wrapper.go:50","message":"New Connection"}
idm-5595968-vs7df idm {"level":"debug","service":"idm","bind_dn":"uid=idp,ou=sysusers,o=libregraph-idm","op":"bind","remote_addr":"10.244.6.228:56946","time":"2024-07-23T15:05:20Z","line":"github.com/owncloud/ocis/v2/ocis-pkg/log/logrus_wrapper.go:50","message":"success"}
proxy-6ffc94748-46z22 proxy {"level":"info","service":"proxy","proto":"HTTP/1.1","request-id":"c49b7d36c992fbb72e6caa13fdae8f9b","traceid":"fa85cba8f3e1c19a131a0123f3882037","remote-addr":"10.244.0.1","method":"GET","status":200,"path":"/konnect/v1/userinfo","duration":75.102222,"bytes":265,"time":"2024-07-23T15:05:20Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/middleware/accesslog.go:34","message":"access-log"}
idp-654fc9cd7d-4m8bk idp {"level":"debug","service":"idp","request-id":"c49b7d36c992fbb72e6caa13fdae8f9b","proto":"HTTP/1.1","method":"GET","status":200,"path":"/konnect/v1/userinfo","duration":72.894994,"bytes":265,"time":"2024-07-23T15:05:20Z","line":"github.com/owncloud/ocis/v2/ocis-pkg/middleware/logger.go:27"}
idm-5595968-vs7df idm {"level":"debug","service":"idm","attrs":["dn","givenName","ownCloudUUID","text","uid","mail","displayName","sn"],"basedn":"ou=users,o=libregraph-idm","binddn":"uid=idp,ou=sysusers,o=libregraph-idm","filter":"(&(&(objectclass=inetOrgPerson)(!(ownCloudUserEnabled=FALSE)))(ownCloudUUID=81bc3848-677f-42af-abd8-405c6a79348c))","op":"search","time":"2024-07-23T15:05:20Z","line":"github.com/owncloud/ocis/v2/ocis-pkg/log/logrus_wrapper.go:50","message":"Calling boltdb search"}
idm-5595968-vs7df idm {"level":"debug","service":"idm","attrs":["dn","givenName","ownCloudUUID","text","uid","mail","displayName","sn"],"basedn":"ou=users,o=libregraph-idm","binddn":"uid=idp,ou=sysusers,o=libregraph-idm","filter":"(&(&(objectclass=inetOrgPerson)(!(ownCloudUserEnabled=FALSE)))(ownCloudUUID=81bc3848-677f-42af-abd8-405c6a79348c))","op":"search","time":"2024-07-23T15:05:20Z","line":"github.com/owncloud/ocis/v2/ocis-pkg/log/logrus_wrapper.go:50","message":"boltdb search returned 7 entries"}
gateway-548c9db6d5-6sczg gateway {"level":"debug","service":"gateway","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","method":"/cs3.gateway.v1beta1.GatewayAPI/Authenticate","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/internal/grpc/interceptors/auth/auth.go:122","message":"skipping auth"}
proxy-6ffc94748-46z22 proxy {"level":"debug","service":"proxy","exp":"2024-07-23 15:06:36 +0000 UTC","time":"2024-07-23T15:05:20Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/middleware/oidc_auth.go:140","message":"Expiration Time from access_token"}
proxy-6ffc94748-46z22 proxy {"level":"debug","service":"proxy","claims":{"aud":"web","email":"[email protected]","email_verified":false,"exp":1721747196,"family_name":"Admin","given_name":"Admin","iat":1721746896,"iss":"https://ocis.kube.owncloud.test","jti":"SCDlU6YO0J4c7XqDOmCjAtl73DM4FWVF","lg.i":{"dn":"Admin","id":"ownCloudUUID=81bc3848-677f-42af-abd8-405c6a79348c","un":"admin"},"lg.p":"identifier-ldap","lg.t":"1","name":"Admin","preferred_username":"admin","scp":"profile email openid","sub":"GaaC3LZ3ywA5_qTK@MH3-31PL7fRAXierXMCeuUVZ8JnkavLKaSnWgn2p_nKVbpOBi2xVstS8ALoseEG-kSehoQ"},"time":"2024-07-23T15:05:20Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/middleware/oidc_auth.go:130","message":"extracted claims"}
proxy-6ffc94748-46z22 proxy {"level":"debug","service":"proxy","authenticator":"oidc","path":"/remote.php/dav/spaces/68008272-be27-419c-aac6-1775980e7769$81bc3848-677f-42af-abd8-405c6a79348c","time":"2024-07-23T15:05:20Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/middleware/oidc_auth.go:194","message":"successfully authenticated request"}
authmachine-698b666b97-fqphx authmachine {"level":"debug","service":"auth-machine","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","method":"/cs3.auth.provider.v1beta1.ProviderAPI/Authenticate","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/internal/grpc/interceptors/auth/auth.go:122","message":"skipping auth"}
gateway-548c9db6d5-6sczg gateway {"level":"debug","service":"gateway","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","method":"/cs3.auth.registry.v1beta1.RegistryAPI/GetAuthProviders","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/internal/grpc/interceptors/auth/auth.go:122","message":"skipping auth"}
gateway-548c9db6d5-6sczg gateway {"level":"debug","service":"gateway","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","user-agent":"grpc-go/1.64.0","from":"tcp://10.244.6.245:34768","uri":"/cs3.auth.registry.v1beta1.RegistryAPI/GetAuthProviders","start":"23/Jul/2024:15:05:20 +0000","end":"23/Jul/2024:15:05:20 +0000","time_ns":45666,"code":"OK","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/internal/grpc/interceptors/log/log.go:69","message":"unary"}
gateway-548c9db6d5-6sczg gateway {"level":"debug","service":"gateway","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","method":"/cs3.gateway.v1beta1.GatewayAPI/GetUserByClaim","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/internal/grpc/interceptors/auth/auth.go:122","message":"skipping auth"}
users-86bc5d5489-csf59 users {"level":"debug","service":"users","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","method":"/cs3.identity.user.v1beta1.UserAPI/GetUserByClaim","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/internal/grpc/interceptors/auth/auth.go:122","message":"skipping auth"}
users-86bc5d5489-csf59 users {"level":"debug","service":"users","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","claim":"username","value":"admin","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/pkg/user/manager/ldap/ldap.go:137","message":"GetUserByClaim"}
users-86bc5d5489-csf59 users {"level":"debug","service":"users","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","backend":"ldap","basedn":"ou=users,o=libregraph-idm","filter":"(&(objectclass=inetOrgPerson)(uid=admin)(!(ownCloudUserEnabled=FALSE)))","scope":2,"time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/pkg/utils/ldap/identity.go:217","message":"LDAP Search"}
gateway-548c9db6d5-6sczg gateway {"level":"debug","service":"gateway","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","user-agent":"grpc-go/1.64.0","from":"tcp://10.244.6.225:33048","uri":"/cs3.gateway.v1beta1.GatewayAPI/GetUserByClaim","start":"23/Jul/2024:15:05:20 +0000","end":"23/Jul/2024:15:05:20 +0000","time_ns":10887399,"code":"OK","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/internal/grpc/interceptors/log/log.go:69","message":"unary"}
gateway-548c9db6d5-6sczg gateway {"level":"debug","service":"gateway","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","user-agent":"grpc-go/1.64.0","from":"tcp://10.244.6.224:59058","uri":"/cs3.gateway.v1beta1.GatewayAPI/Authenticate","start":"23/Jul/2024:15:05:20 +0000","end":"23/Jul/2024:15:05:20 +0000","time_ns":19673269,"code":"OK","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/internal/grpc/interceptors/log/log.go:69","message":"unary"}
idm-5595968-vs7df idm {"level":"debug","service":"idm","attrs":["displayname","ownclouduuid","mail","uid","uidNumber","gidNumber","ownCloudUserEnabled","ownCloudUserType"],"basedn":"ou=users,o=libregraph-idm","binddn":"uid=reva,ou=sysusers,o=libregraph-idm","filter":"(&(objectclass=inetOrgPerson)(uid=admin)(!(ownCloudUserEnabled=FALSE)))","op":"search","time":"2024-07-23T15:05:20Z","line":"github.com/owncloud/ocis/v2/ocis-pkg/log/logrus_wrapper.go:50","message":"Calling boltdb search"}
idm-5595968-vs7df idm {"level":"debug","service":"idm","attrs":["displayname","ownclouduuid","mail","uid","uidNumber","gidNumber","ownCloudUserEnabled","ownCloudUserType"],"basedn":"ou=users,o=libregraph-idm","binddn":"uid=reva,ou=sysusers,o=libregraph-idm","filter":"(&(objectclass=inetOrgPerson)(uid=admin)(!(ownCloudUserEnabled=FALSE)))","op":"search","time":"2024-07-23T15:05:20Z","line":"github.com/owncloud/ocis/v2/ocis-pkg/log/logrus_wrapper.go:50","message":"boltdb search returned 7 entries"}
idm-5595968-vs7df idm {"level":"debug","service":"idm","attrs":["ownclouduuid"],"basedn":"ou=groups,o=libregraph-idm","binddn":"uid=reva,ou=sysusers,o=libregraph-idm","filter":"(&(objectclass=groupOfNames)(member=uid=admin,ou=users,o=libregraph-idm))","op":"search","time":"2024-07-23T15:05:20Z","line":"github.com/owncloud/ocis/v2/ocis-pkg/log/logrus_wrapper.go:50","message":"Calling boltdb search"}
idm-5595968-vs7df idm {"level":"debug","service":"idm","attrs":["ownclouduuid"],"basedn":"ou=groups,o=libregraph-idm","binddn":"uid=reva,ou=sysusers,o=libregraph-idm","filter":"(&(objectclass=groupOfNames)(member=uid=admin,ou=users,o=libregraph-idm))","op":"search","time":"2024-07-23T15:05:20Z","line":"github.com/owncloud/ocis/v2/ocis-pkg/log/logrus_wrapper.go:50","message":"boltdb search returned 9 entries"}
proxy-6ffc94748-46z22 proxy {"level":"debug","service":"proxy","claims":{"aud":"web","email":"[email protected]","email_verified":false,"exp":1721747196,"family_name":"Admin","given_name":"Admin","iat":1721746896,"iss":"https://ocis.kube.owncloud.test","jti":"SCDlU6YO0J4c7XqDOmCjAtl73DM4FWVF","lg.i":{"dn":"Admin","id":"ownCloudUUID=81bc3848-677f-42af-abd8-405c6a79348c","un":"admin"},"lg.p":"identifier-ldap","lg.t":"1","name":"Admin","preferred_username":"admin","scp":"profile email openid","sub":"GaaC3LZ3ywA5_qTK@MH3-31PL7fRAXierXMCeuUVZ8JnkavLKaSnWgn2p_nKVbpOBi2xVstS8ALoseEG-kSehoQ"},"user":{"id":{"idp":"https://ocis.kube.owncloud.test","opaque_id":"81bc3848-677f-42af-abd8-405c6a79348c","type":1},"username":"admin","mail":"[email protected]","display_name":"Admin","groups":["509a9dcd-bb37-4f4f-a01a-19dca27d9cfa"],"opaque":{"map":{"roles":{"decoder":"json","value":"WyI3MTg4MTg4My0xNzY4LTQ2YmQtYTI0ZC1hMzU2YTJhZmRmN2YiXQ=="}}},"uid_number":99,"gid_number":99},"time":"2024-07-23T15:05:20Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/middleware/account_resolver.go:179","message":"associated claims with user"}
users-86bc5d5489-csf59 users {"level":"debug","service":"users","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","entry":{"DN":"uid=admin,ou=users,o=libregraph-idm","Attributes":[{"Name":"displayName","Values":["Admin"],"ByteValues":["QWRtaW4="]},{"Name":"mail","Values":["[email protected]"],"ByteValues":["YWRtaW5AZXhhbXBsZS5vcmc="]},{"Name":"ownCloudUUID","Values":["81bc3848-677f-42af-abd8-405c6a79348c"],"ByteValues":["ODFiYzM4NDgtNjc3Zi00MmFmLWFiZDgtNDA1YzZhNzkzNDhj"]},{"Name":"uid","Values":["admin"],"ByteValues":["YWRtaW4="]}]},"time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/pkg/user/manager/ldap/ldap.go:144","message":"entries"}
users-86bc5d5489-csf59 users {"level":"debug","service":"users","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","backend":"ldap","basedn":"ou=groups,o=libregraph-idm","filter":"(&(objectclass=groupOfNames)(member=uid=admin,ou=users,o=libregraph-idm))","scope":2,"time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/pkg/utils/ldap/identity.go:349","message":"LDAP Search"}
users-86bc5d5489-csf59 users {"level":"debug","service":"users","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","user-agent":"grpc-go/1.64.0","from":"tcp://10.244.6.245:48480","uri":"/cs3.identity.user.v1beta1.UserAPI/GetUserByClaim","start":"23/Jul/2024:15:05:20 +0000","end":"23/Jul/2024:15:05:20 +0000","time_ns":6802404,"code":"OK","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/internal/grpc/interceptors/log/log.go:69","message":"unary"}
authmachine-698b666b97-fqphx authmachine {"level":"info","service":"auth-machine","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/internal/grpc/services/authprovider/authprovider.go:145","message":"user idp:\"https://ocis.kube.owncloud.test\" opaque_id:\"81bc3848-677f-42af-abd8-405c6a79348c\" type:USER_TYPE_PRIMARY  authenticated"}
gateway-548c9db6d5-6sczg gateway {"level":"debug","service":"gateway","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","method":"/cs3.gateway.v1beta1.GatewayAPI/CreateHome","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/internal/grpc/interceptors/auth/auth.go:122","message":"skipping auth"}
gateway-548c9db6d5-6sczg gateway {"level":"debug","service":"gateway","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","user-agent":"grpc-go/1.64.0","from":"tcp://10.244.6.245:34776","uri":"/cs3.storage.registry.v1beta1.RegistryAPI/GetStorageProviders","start":"23/Jul/2024:15:05:20 +0000","end":"23/Jul/2024:15:05:20 +0000","time_ns":388302,"code":"OK","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/internal/grpc/interceptors/log/log.go:69","message":"unary"}
authmachine-698b666b97-fqphx authmachine {"level":"debug","service":"auth-machine","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","user-agent":"grpc-go/1.64.0","from":"tcp://10.244.6.245:42458","uri":"/cs3.auth.provider.v1beta1.ProviderAPI/Authenticate","start":"23/Jul/2024:15:05:20 +0000","end":"23/Jul/2024:15:05:20 +0000","time_ns":13484622,"code":"OK","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/internal/grpc/interceptors/log/log.go:69","message":"unary"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"debug","service":"storage-users","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","user-agent":"grpc-go/1.64.0","from":"tcp://10.244.6.245:38666","uri":"/cs3.storage.provider.v1beta1.ProviderAPI/CreateStorageSpace","start":"23/Jul/2024:15:05:20 +0000","end":"23/Jul/2024:15:05:20 +0000","time_ns":5357633,"code":"OK","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/internal/grpc/interceptors/log/log.go:69","message":"unary"}
gateway-548c9db6d5-6sczg gateway {"level":"debug","service":"gateway","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","user-agent":"grpc-go/1.64.0","from":"tcp://10.244.6.224:59058","uri":"/cs3.gateway.v1beta1.GatewayAPI/CreateHome","start":"23/Jul/2024:15:05:20 +0000","end":"23/Jul/2024:15:05:20 +0000","time_ns":10334888,"code":"OK","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/internal/grpc/interceptors/log/log.go:69","message":"unary"}
ocdav-6945c7997b-snf4j ocdav {"level":"debug","service":"ocdav","name":"com.owncloud.web.ocdav","traceid":"e57251c5f7b95dc640d7b02f88034ded","request-id":"469be25d-5342-4ca5-854c-78a45364bd87","head":"remote.php","tail":"/dav/spaces/68008272-be27-419c-aac6-1775980e7769$81bc3848-677f-42af-abd8-405c6a79348c","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/internal/http/services/owncloud/ocdav/ocdav.go:181","message":"http routing"}
gateway-548c9db6d5-6sczg gateway {"level":"debug","service":"gateway","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","method":"/cs3.gateway.v1beta1.GatewayAPI/Stat","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/internal/grpc/interceptors/auth/auth.go:122","message":"skipping auth"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"debug","service":"storage-users","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","user-agent":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/126.0.0.0 Safari/537.36","from":"tcp://10.244.6.245:38666","uri":"/cs3.storage.provider.v1beta1.ProviderAPI/Stat","start":"23/Jul/2024:15:05:20 +0000","end":"23/Jul/2024:15:05:20 +0000","time_ns":740595,"code":"OK","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/internal/grpc/interceptors/log/log.go:69","message":"unary"}
gateway-548c9db6d5-6sczg gateway {"level":"debug","service":"gateway","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","user-agent":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/126.0.0.0 Safari/537.36","from":"tcp://10.244.6.245:34776","uri":"/cs3.storage.registry.v1beta1.RegistryAPI/ListStorageProviders","start":"23/Jul/2024:15:05:20 +0000","end":"23/Jul/2024:15:05:20 +0000","time_ns":205156,"code":"OK","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/internal/grpc/interceptors/log/log.go:69","message":"unary"}
gateway-548c9db6d5-6sczg gateway {"level":"debug","service":"gateway","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","user-agent":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/126.0.0.0 Safari/537.36","from":"tcp://10.244.6.235:36872","uri":"/cs3.gateway.v1beta1.GatewayAPI/Stat","start":"23/Jul/2024:15:05:20 +0000","end":"23/Jul/2024:15:05:20 +0000","time_ns":3275670,"code":"OK","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/internal/grpc/interceptors/log/log.go:69","message":"unary"}
gateway-548c9db6d5-6sczg gateway {"level":"debug","service":"gateway","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","method":"/cs3.gateway.v1beta1.GatewayAPI/InitiateFileUpload","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/internal/grpc/interceptors/auth/auth.go:122","message":"skipping auth"}
gateway-548c9db6d5-6sczg gateway {"level":"debug","service":"gateway","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","user-agent":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/126.0.0.0 Safari/537.36","from":"tcp://10.244.6.245:34776","uri":"/cs3.storage.registry.v1beta1.RegistryAPI/ListStorageProviders","start":"23/Jul/2024:15:05:20 +0000","end":"23/Jul/2024:15:05:20 +0000","time_ns":337436,"code":"OK","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/internal/grpc/interceptors/log/log.go:69","message":"unary"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"debug","service":"storage-users","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","uploadid":"1933495d-3d34-462c-9f93-dc69390fd171","spaceid":"81bc3848-677f-42af-abd8-405c6a79348c","nodeid":"","metadata":{"expires":"1721833520","mtime":"1689686682","providerID":"68008272-be27-419c-aac6-1775980e7769"},"time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/pkg/storage/utils/decomposedfs/upload.go:231","message":"Decomposedfs: resolved filename"}
gateway-548c9db6d5-6sczg gateway {"level":"debug","service":"gateway","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","user-agent":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/126.0.0.0 Safari/537.36","from":"tcp://10.244.6.235:36872","uri":"/cs3.gateway.v1beta1.GatewayAPI/InitiateFileUpload","start":"23/Jul/2024:15:05:20 +0000","end":"23/Jul/2024:15:05:20 +0000","time_ns":9664335,"code":"OK","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/internal/grpc/interceptors/log/log.go:69","message":"unary"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"debug","service":"storage-users","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","spaceid":"81bc3848-677f-42af-abd8-405c6a79348c","nodeid":"81bc3848-677f-42af-abd8-405c6a79348c","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/pkg/storage/utils/decomposedfs/node/node.go:1008","message":"user is owner, returning owner permissions"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"debug","service":"storage-users","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","session":{},"time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/pkg/storage/utils/decomposedfs/upload.go:305","message":"Decomposedfs: built session info"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"info","service":"storage-users","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","data-server":"http://storageusers:9158/data/simple/1933495d-3d34-462c-9f93-dc69390fd171","fn":"./500MB PDF File.pdf","xs":"map[md5:100 unset:1000]","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/internal/grpc/services/storageprovider/storageprovider.go:466","message":"file upload"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"info","service":"storage-users","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","data-server":"http://storageusers:9158/data/tus/1933495d-3d34-462c-9f93-dc69390fd171","fn":"./500MB PDF File.pdf","xs":"map[md5:100 unset:1000]","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/internal/grpc/services/storageprovider/storageprovider.go:466","message":"file upload"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"debug","service":"storage-users","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","user-agent":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/126.0.0.0 Safari/537.36","from":"tcp://10.244.6.245:38666","uri":"/cs3.storage.provider.v1beta1.ProviderAPI/InitiateFileUpload","start":"23/Jul/2024:15:05:20 +0000","end":"23/Jul/2024:15:05:20 +0000","time_ns":5907358,"code":"OK","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/internal/grpc/interceptors/log/log.go:69","message":"unary"}
proxy-6ffc94748-46z22 proxy {"level":"debug","service":"proxy","policy":"ocis","method":"PATCH","prefix":"/data","path":"/data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMzNTIwLCJpYXQiOjE3MjE3NDcxMjAsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy8xOTMzNDk1ZC0zZDM0LTQ2MmMtOWY5My1kYzY5MzkwZmQxNzEifQ.dj49zGLpJGQD_8-0g6b0fXNLdmqAFKZzWGhrbUANP_g","routeType":"prefix","time":"2024-07-23T15:05:20Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/router/router.go:224","message":"rewrite hook found"}
gateway-548c9db6d5-6sczg gateway {"level":"debug","service":"gateway","pkg":"rgrpc","traceid":"1d3333d01d7c8842ca73937a21cbc371","method":"/cs3.gateway.v1beta1.GatewayAPI/CreateHome","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/internal/grpc/interceptors/auth/auth.go:122","message":"skipping auth"}
frontend-76488f8c76-2hxq5 frontend {"level":"info","service":"frontend","pkg":"rhttp","traceid":"4072941c10f60f256679c1d696f97788","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/internal/http/interceptors/auth/auth.go:195","message":"skipping auth check for: /data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMzNTIwLCJpYXQiOjE3MjE3NDcxMjAsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy8xOTMzNDk1ZC0zZDM0LTQ2MmMtOWY5My1kYzY5MzkwZmQxNzEifQ.dj49zGLpJGQD_8-0g6b0fXNLdmqAFKZzWGhrbUANP_g"}
gateway-548c9db6d5-6sczg gateway {"level":"debug","service":"gateway","pkg":"rgrpc","traceid":"1d3333d01d7c8842ca73937a21cbc371","user-agent":"grpc-go/1.64.0","from":"tcp://10.244.6.245:34776","uri":"/cs3.storage.registry.v1beta1.RegistryAPI/GetStorageProviders","start":"23/Jul/2024:15:05:20 +0000","end":"23/Jul/2024:15:05:20 +0000","time_ns":280038,"code":"OK","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/internal/grpc/interceptors/log/log.go:69","message":"unary"}
gateway-548c9db6d5-6sczg gateway {"level":"debug","service":"gateway","pkg":"rgrpc","traceid":"1d3333d01d7c8842ca73937a21cbc371","user-agent":"grpc-go/1.64.0","from":"tcp://10.244.6.224:59058","uri":"/cs3.gateway.v1beta1.GatewayAPI/CreateHome","start":"23/Jul/2024:15:05:20 +0000","end":"23/Jul/2024:15:05:20 +0000","time_ns":1871645,"code":"OK","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/internal/grpc/interceptors/log/log.go:69","message":"unary"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"info","service":"storage-users","pkg":"rhttp","traceid":"f2bb17f252bc6f66584a43f894009a80","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/internal/http/interceptors/auth/auth.go:195","message":"skipping auth check for: /data/tus/1933495d-3d34-462c-9f93-dc69390fd171"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"debug","service":"storage-users","pkg":"rhttp","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/pkg/rhttp/rhttp.go:248","message":"http routing: head=data tail=/tus/1933495d-3d34-462c-9f93-dc69390fd171 svc=data"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"debug","service":"storage-users","pkg":"rhttp","traceid":"f2bb17f252bc6f66584a43f894009a80","request-id":"c1a377557f22582fb4b79f8276c57354","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/internal/http/services/dataprovider/dataprovider.go:179","message":"dataprovider routing: path=/tus/1933495d-3d34-462c-9f93-dc69390fd171"}
frontend-76488f8c76-2hxq5 frontend {"level":"debug","service":"frontend","pkg":"rhttp","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/pkg/rhttp/rhttp.go:248","message":"http routing: head=data tail=/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMzNTIwLCJpYXQiOjE3MjE3NDcxMjAsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy8xOTMzNDk1ZC0zZDM0LTQ2MmMtOWY5My1kYzY5MzkwZmQxNzEifQ.dj49zGLpJGQD_8-0g6b0fXNLdmqAFKZzWGhrbUANP_g svc=data"}
frontend-76488f8c76-2hxq5 frontend {"level":"debug","service":"frontend","pkg":"rhttp","traceid":"4072941c10f60f256679c1d696f97788","request-id":"c1a377557f22582fb4b79f8276c57354","target":"http://storageusers:9158/data/tus/1933495d-3d34-462c-9f93-dc69390fd171","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/internal/http/services/datagateway/datagateway.go:187","message":"sending request to internal data server"}
proxy-6ffc94748-46z22 proxy {"level":"info","service":"proxy","proto":"HTTP/1.1","request-id":"c1a377557f22582fb4b79f8276c57354","traceid":"1d3333d01d7c8842ca73937a21cbc371","remote-addr":"10.244.0.1","method":"PATCH","status":204,"path":"/data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMzNTIwLCJpYXQiOjE3MjE3NDcxMjAsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy8xOTMzNDk1ZC0zZDM0LTQ2MmMtOWY5My1kYzY5MzkwZmQxNzEifQ.dj49zGLpJGQD_8-0g6b0fXNLdmqAFKZzWGhrbUANP_g","duration":56.301657,"bytes":0,"time":"2024-07-23T15:05:20Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/middleware/accesslog.go:34","message":"access-log"}
frontend-76488f8c76-2hxq5 frontend {"level":"debug","service":"frontend","pkg":"rhttp","traceid":"4072941c10f60f256679c1d696f97788","host":"10.244.6.224","method":"PATCH","uri":"/data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMzNTIwLCJpYXQiOjE3MjE3NDcxMjAsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy8xOTMzNDk1ZC0zZDM0LTQ2MmMtOWY5My1kYzY5MzkwZmQxNzEifQ.dj49zGLpJGQD_8-0g6b0fXNLdmqAFKZzWGhrbUANP_g","url":"/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMzNTIwLCJpYXQiOjE3MjE3NDcxMjAsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy8xOTMzNDk1ZC0zZDM0LTQ2MmMtOWY5My1kYzY5MzkwZmQxNzEifQ.dj49zGLpJGQD_8-0g6b0fXNLdmqAFKZzWGhrbUANP_g","proto":"HTTP/1.1","status":204,"size":0,"start":"23/Jul/2024:15:05:20 +0000","end":"23/Jul/2024:15:05:20 +0000","time_ns":50896906,"time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/internal/http/interceptors/log/log.go:112","message":"http"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"debug","service":"storage-users","pkg":"rhttp","traceid":"f2bb17f252bc6f66584a43f894009a80","host":"10.244.6.246","method":"PATCH","uri":"/data/tus/1933495d-3d34-462c-9f93-dc69390fd171","url":"/1933495d-3d34-462c-9f93-dc69390fd171","proto":"HTTP/1.1","status":204,"size":0,"start":"23/Jul/2024:15:05:20 +0000","end":"23/Jul/2024:15:05:20 +0000","time_ns":45727648,"time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/internal/http/interceptors/log/log.go:112","message":"http"}
proxy-6ffc94748-46z22 proxy {"level":"info","service":"proxy","proto":"HTTP/1.1","request-id":"469be25d-5342-4ca5-854c-78a45364bd87","traceid":"e57251c5f7b95dc640d7b02f88034ded","remote-addr":"192.168.49.1","method":"POST","status":201,"path":"/remote.php/dav/spaces/68008272-be27-419c-aac6-1775980e7769$81bc3848-677f-42af-abd8-405c6a79348c","duration":301.550136,"bytes":0,"time":"2024-07-23T15:05:20Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/middleware/accesslog.go:34","message":"access-log"}
frontend-76488f8c76-2hxq5 frontend {"level":"info","service":"frontend","pkg":"rhttp","traceid":"13c93ca06cc8ab002967a3b2c48a1a13","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/internal/http/interceptors/auth/auth.go:195","message":"skipping auth check for: /data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMzNTIwLCJpYXQiOjE3MjE3NDcxMjAsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy8xOTMzNDk1ZC0zZDM0LTQ2MmMtOWY5My1kYzY5MzkwZmQxNzEifQ.dj49zGLpJGQD_8-0g6b0fXNLdmqAFKZzWGhrbUANP_g"}
frontend-76488f8c76-2hxq5 frontend {"level":"warn","service":"frontend","pkg":"rhttp","traceid":"13c93ca06cc8ab002967a3b2c48a1a13","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/internal/http/interceptors/auth/auth.go:248","message":"core access token not set"}
proxy-6ffc94748-46z22 proxy {"level":"debug","service":"proxy","policy":"ocis","method":"PATCH","prefix":"/data","path":"/data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMzNTIwLCJpYXQiOjE3MjE3NDcxMjAsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy8xOTMzNDk1ZC0zZDM0LTQ2MmMtOWY5My1kYzY5MzkwZmQxNzEifQ.dj49zGLpJGQD_8-0g6b0fXNLdmqAFKZzWGhrbUANP_g","routeType":"prefix","time":"2024-07-23T15:05:20Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/router/router.go:224","message":"rewrite hook found"}
frontend-76488f8c76-2hxq5 frontend {"level":"debug","service":"frontend","pkg":"rhttp","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/pkg/rhttp/rhttp.go:248","message":"http routing: head=data tail=/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMzNTIwLCJpYXQiOjE3MjE3NDcxMjAsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy8xOTMzNDk1ZC0zZDM0LTQ2MmMtOWY5My1kYzY5MzkwZmQxNzEifQ.dj49zGLpJGQD_8-0g6b0fXNLdmqAFKZzWGhrbUANP_g svc=data"}
frontend-76488f8c76-2hxq5 frontend {"level":"debug","service":"frontend","pkg":"rhttp","traceid":"13c93ca06cc8ab002967a3b2c48a1a13","request-id":"469be25d-5342-4ca5-854c-78a45364bd87","target":"http://storageusers:9158/data/tus/1933495d-3d34-462c-9f93-dc69390fd171","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/internal/http/services/datagateway/datagateway.go:187","message":"sending request to internal data server"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"info","service":"storage-users","pkg":"rhttp","traceid":"9828feb8c2a0b8b338d0ef5619e45cd5","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/internal/http/interceptors/auth/auth.go:195","message":"skipping auth check for: /data/tus/1933495d-3d34-462c-9f93-dc69390fd171"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"warn","service":"storage-users","pkg":"rhttp","traceid":"9828feb8c2a0b8b338d0ef5619e45cd5","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/internal/http/interceptors/auth/auth.go:248","message":"core access token not set"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"debug","service":"storage-users","pkg":"rhttp","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/pkg/rhttp/rhttp.go:248","message":"http routing: head=data tail=/tus/1933495d-3d34-462c-9f93-dc69390fd171 svc=data"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"debug","service":"storage-users","pkg":"rhttp","traceid":"9828feb8c2a0b8b338d0ef5619e45cd5","request-id":"469be25d-5342-4ca5-854c-78a45364bd87","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/internal/http/services/dataprovider/dataprovider.go:179","message":"dataprovider routing: path=/tus/1933495d-3d34-462c-9f93-dc69390fd171"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"warn","service":"storage-users","pkg":"rhttp","traceid":"9828feb8c2a0b8b338d0ef5619e45cd5","host":"10.244.6.246","method":"PATCH","uri":"/data/tus/1933495d-3d34-462c-9f93-dc69390fd171","url":"/1933495d-3d34-462c-9f93-dc69390fd171","proto":"HTTP/1.1","status":403,"size":30,"start":"23/Jul/2024:15:05:20 +0000","end":"23/Jul/2024:15:05:20 +0000","time_ns":212400,"time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/internal/http/interceptors/log/log.go:112","message":"http"}
frontend-76488f8c76-2hxq5 frontend {"level":"warn","service":"frontend","pkg":"rhttp","traceid":"13c93ca06cc8ab002967a3b2c48a1a13","host":"10.244.6.224","method":"PATCH","uri":"/data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMzNTIwLCJpYXQiOjE3MjE3NDcxMjAsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy8xOTMzNDk1ZC0zZDM0LTQ2MmMtOWY5My1kYzY5MzkwZmQxNzEifQ.dj49zGLpJGQD_8-0g6b0fXNLdmqAFKZzWGhrbUANP_g","url":"/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMzNTIwLCJpYXQiOjE3MjE3NDcxMjAsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy8xOTMzNDk1ZC0zZDM0LTQ2MmMtOWY5My1kYzY5MzkwZmQxNzEifQ.dj49zGLpJGQD_8-0g6b0fXNLdmqAFKZzWGhrbUANP_g","proto":"HTTP/1.1","status":403,"size":0,"start":"23/Jul/2024:15:05:20 +0000","end":"23/Jul/2024:15:05:20 +0000","time_ns":2027449,"time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/[email protected]/internal/http/interceptors/log/log.go:112","message":"http"}
proxy-6ffc94748-46z22 proxy {"level":"info","service":"proxy","proto":"HTTP/1.1","request-id":"469be25d-5342-4ca5-854c-78a45364bd87","traceid":"cc821d770b6152d172edc86ce14ad15a","remote-addr":"192.168.49.1","method":"PATCH","status":403,"path":"/data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMzNTIwLCJpYXQiOjE3MjE3NDcxMjAsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy8xOTMzNDk1ZC0zZDM0LTQ2MmMtOWY5My1kYzY5MzkwZmQxNzEifQ.dj49zGLpJGQD_8-0g6b0fXNLdmqAFKZzWGhrbUANP_g","duration":3.1269,"bytes":0,"time":"2024-07-23T15:05:20Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/middleware/accesslog.go:34","message":"access-log"}

wkloucek avatar Jul 23 '24 15:07 wkloucek

The nginx logs while uploading a file for the first time:

ngress-nginx-controller-768f948f8f-hmkgh controller 2024/07/23 15:12:32 [warn] 1287#1287: *119782 a client request body is buffered to a temporary file /tmp/nginx/client-body/0000000023, client: 192.168.49.1, server: ocis.kube.owncloud.test, request: "POST /remote.php/dav/spaces/68008272-be27-419c-aac6-1775980e7769$81bc3848-677f-42af-abd8-405c6a79348c HTTP/2.0", host: "ocis.kube.owncloud.test", referrer: "https://ocis.kube.owncloud.test/files/spaces/personal/admin?fileId=68008272-be27-419c-aac6-1775980e7769%2481bc3848-677f-42af-abd8-405c6a79348c%2181bc3848-677f-42af-abd8-405c6a79348c&sort-by=name&sort-dir=asc&items-per-page=100&files-spaces-generic-view-mode=resource-table&tiles-size=1"
ingress-nginx-controller-768f948f8f-hmkgh controller 10.244.0.1 - - [23/Jul/2024:15:12:33 +0000] "GET /konnect/v1/userinfo HTTP/1.1" 200 265 "-" "Go-http-client/1.1" 1422 0.104 [ocis-proxy-9200] [] 10.244.6.224:9200 265 0.104 200 092754d0d0b56d1111069b92616d21db
ingress-nginx-controller-768f948f8f-hmkgh controller 2024/07/23 15:12:33 [warn] 1273#1273: *196342 a client request body is buffered to a temporary file /tmp/nginx/client-body/0000000024, client: 10.244.0.1, server: ocis.kube.owncloud.test, request: "PATCH /data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMzOTUzLCJpYXQiOjE3MjE3NDc1NTMsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy9iNWMyOTQxNC0yN2FmLTRmNDctYTBlYS0zN2ZiMmVjNDZkYWQifQ.B1MeGqpWUkEuCfaMJSoKNbYAyd88k911mCFoVG2zEOk HTTP/2.0", host: "ocis.kube.owncloud.test"
ingress-nginx-controller-768f948f8f-hmkgh controller 10.244.0.1 - - [23/Jul/2024:15:12:33 +0000] "PATCH /data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMzOTUzLCJpYXQiOjE3MjE3NDc1NTMsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy9iNWMyOTQxNC0yN2FmLTRmNDctYTBlYS0zN2ZiMmVjNDZkYWQifQ.B1MeGqpWUkEuCfaMJSoKNbYAyd88k911mCFoVG2zEOk HTTP/2.0" 204 0 "-" "Go-http-client/2.0" 10000984 0.081 [ocis-proxy-9200] [] 10.244.6.224:9200 0 0.038 204 74ede80410705da03a9f87cb0a8798ca
ingress-nginx-controller-768f948f8f-hmkgh controller 192.168.49.1 - - [23/Jul/2024:15:12:33 +0000] "POST /remote.php/dav/spaces/68008272-be27-419c-aac6-1775980e7769$81bc3848-677f-42af-abd8-405c6a79348c HTTP/2.0" 201 0 "https://ocis.kube.owncloud.test/files/spaces/personal/admin?fileId=68008272-be27-419c-aac6-1775980e7769%2481bc3848-677f-42af-abd8-405c6a79348c%2181bc3848-677f-42af-abd8-405c6a79348c&sort-by=name&sort-dir=asc&items-per-page=100&files-spaces-generic-view-mode=resource-table&tiles-size=1" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/126.0.0.0 Safari/537.36" 10000900 0.333 [ocis-proxy-9200] [] 10.244.6.224:9200 0 0.250 201 73601c48-f255-42c4-a910-1753c58a7c0b
ingress-nginx-controller-768f948f8f-hmkgh controller 2024/07/23 15:12:33 [warn] 1287#1287: *119782 a client request body is buffered to a temporary file /tmp/nginx/client-body/0000000025, client: 192.168.49.1, server: ocis.kube.owncloud.test, request: "PATCH /data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMzOTUzLCJpYXQiOjE3MjE3NDc1NTMsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy9iNWMyOTQxNC0yN2FmLTRmNDctYTBlYS0zN2ZiMmVjNDZkYWQifQ.B1MeGqpWUkEuCfaMJSoKNbYAyd88k911mCFoVG2zEOk HTTP/2.0", host: "ocis.kube.owncloud.test", referrer: "https://ocis.kube.owncloud.test/files/spaces/personal/admin?fileId=68008272-be27-419c-aac6-1775980e7769%2481bc3848-677f-42af-abd8-405c6a79348c%2181bc3848-677f-42af-abd8-405c6a79348c&sort-by=name&sort-dir=asc&items-per-page=100&files-spaces-generic-view-mode=resource-table&tiles-size=1"
ingress-nginx-controller-768f948f8f-hmkgh controller 2024/07/23 15:12:33 [error] 1287#1287: *119782 writev() failed (104: Connection reset by peer) while sending request to upstream, client: 192.168.49.1, server: ocis.kube.owncloud.test, request: "PATCH /data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMzOTUzLCJpYXQiOjE3MjE3NDc1NTMsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy9iNWMyOTQxNC0yN2FmLTRmNDctYTBlYS0zN2ZiMmVjNDZkYWQifQ.B1MeGqpWUkEuCfaMJSoKNbYAyd88k911mCFoVG2zEOk HTTP/2.0", upstream: "http://10.244.6.224:9200/data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMzOTUzLCJpYXQiOjE3MjE3NDc1NTMsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy9iNWMyOTQxNC0yN2FmLTRmNDctYTBlYS0zN2ZiMmVjNDZkYWQifQ.B1MeGqpWUkEuCfaMJSoKNbYAyd88k911mCFoVG2zEOk", host: "ocis.kube.owncloud.test", referrer: "https://ocis.kube.owncloud.test/files/spaces/personal/admin?fileId=68008272-be27-419c-aac6-1775980e7769%2481bc3848-677f-42af-abd8-405c6a79348c%2181bc3848-677f-42af-abd8-405c6a79348c&sort-by=name&sort-dir=asc&items-per-page=100&files-spaces-generic-view-mode=resource-table&tiles-size=1"
ingress-nginx-controller-768f948f8f-hmkgh controller 192.168.49.1 - - [23/Jul/2024:15:12:33 +0000] "PATCH /data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMzOTUzLCJpYXQiOjE3MjE3NDc1NTMsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy9iNWMyOTQxNC0yN2FmLTRmNDctYTBlYS0zN2ZiMmVjNDZkYWQifQ.B1MeGqpWUkEuCfaMJSoKNbYAyd88k911mCFoVG2zEOk HTTP/2.0" 502 552 "https://ocis.kube.owncloud.test/files/spaces/personal/admin?fileId=68008272-be27-419c-aac6-1775980e7769%2481bc3848-677f-42af-abd8-405c6a79348c%2181bc3848-677f-42af-abd8-405c6a79348c&sort-by=name&sort-dir=asc&items-per-page=100&files-spaces-generic-view-mode=resource-table&tiles-size=1" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/126.0.0.0 Safari/537.36" 10000597 0.057 [ocis-proxy-9200] [] 10.244.6.224:9200 0 0.000 502 73601c48-f255-42c4-a910-1753c58a7c0b

wkloucek avatar Jul 23 '24 15:07 wkloucek

@case0sh @d7oc could you please test if that still applies to oCIS 6.2? I tested it with 6.1

wkloucek avatar Aug 08 '24 11:08 wkloucek

At least I can't upload at 59MB file:

Screenshot 2024-08-08 at 18 49 20

excerpt from proxy log:

{"level":"info","service":"proxy","proto":"HTTP/1.1","request-id":"7f50c924-926a-4d4c-826a-b9b25602c3f3","traceid":"2180cc712e43146da01cf34fba55899f","remote-addr":"92.117.247.254","method":"POST","status":201,"path":"/remote.php/dav/spaces/a0bc72a0-1478-411a-8ca5-788f13c7ad1a$5dd10401-0b20-481e-bee0-cd89ccb4cada","duration":7993.371942,"bytes":0,"time":"2024-08-08T16:45:23Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/middleware/accesslog.go:34","message":"access-log"}
{"level":"info","service":"proxy","proto":"HTTP/1.1","request-id":"7f50c924-926a-4d4c-826a-b9b25602c3f3","traceid":"2fa46653d945fc3b0a915d60d7b799f3","remote-addr":"92.117.247.254","method":"PATCH","status":403,"path":"/data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIzMjIxOTE1LCJpYXQiOjE3MjMxMzU1MTUsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy83ZWU3NWJhZC02MzUwLTQ0MGQtODBlMy0wZjBkNWM3YjQ4YzYifQ.6hBU-nCGvdnNNdTv7UcFg6H9ELjqZN2DnloGkvWJNks","duration":23.432487,"bytes":0,"time":"2024-08-08T16:45:23Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/middleware/accesslog.go:34","message":"access-log"}

d7oc avatar Aug 08 '24 16:08 d7oc

The behaviour also seems to differ by browser. Above's screenshot was from Safari. This one is from Firefox with dev tool enabled:

Screenshot 2024-08-08 at 18 51 25

d7oc avatar Aug 08 '24 16:08 d7oc

Also worth noting is the fancy animation which jumps backwards:

https://github.com/user-attachments/assets/69a358be-b8cb-4064-84c3-21b40b315b28

d7oc avatar Aug 08 '24 16:08 d7oc

@micbar @wkloucek Any clue where we could start the investigation? For me this is a blocker for oCIS 6 usage.

d7oc avatar Aug 08 '24 17:08 d7oc

@dragotin @d7oc @wkloucek

Found it. It was cors. storage-users service also needs the cors configuration for the PATCH requests. I needed this fix for the helmchart: https://github.com/owncloud/ocis-charts/pull/675

Additionally, I set

cors:                                                                                                                                                                                                                                                                              
    #-- allow_origins is a list of origins a cross-domain request can be executed from.                                                                                                                                                                                              
    # If the special "*" value is present in the list, all origins will be allowed.                                                                                                                                                                                                  
    allow_origins: ["ocis.kube.owncloud.test"]

in my values.yaml.

kobergj avatar Aug 09 '24 14:08 kobergj

Just for curiosity: Why hasn't this been an issue with oCIS 5? I meant we also did TUS uploads in oCIS 5, didn't we?

d7oc avatar Aug 09 '24 14:08 d7oc

Good question. We bumped the tusd package recently to newer version. Also we did some improvements to cors lately. My best guess that it wasn't working as it should before. Now that we've updated the dependencies the feature works properly and therefore throws an error. (Just a guess though...)

kobergj avatar Aug 09 '24 14:08 kobergj

Closing as https://github.com/owncloud/ocis-charts/pull/675 got merged. Please reopen if issue persists.

kobergj avatar Aug 12 '24 07:08 kobergj

@d7oc @case0sh @kobergj I don't see this fixed on my side. I still have it.

wkloucek avatar Sep 11 '24 12:09 wkloucek

This are the logs when trying to continue the upload after the first time abort:

frontend-74d884d78c-hztzx frontend {"level":"info","service":"frontend","pkg":"rhttp","traceid":"69d216f26e72688171a0d15692cadf0d","time":"2024-09-11T12:33:40Z","line":"github.com/cs3org/reva/[email protected]/internal/http/interceptors/auth/auth.go:195","message":"skipping auth check for: /data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzI2MTQ0MjM2LCJpYXQiOjE3MjYwNTc4MzYsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy9kZjFlYTZjNC1iNzBjLTQ3NjYtYTkxYy1kYjIwNDk1NmQ4NDcifQ.IS0F0XJqtwEmw99CiPLyfm4L-aOOZt8wutHJlAv68t8"}
frontend-74d884d78c-hztzx frontend {"level":"warn","service":"frontend","pkg":"rhttp","traceid":"69d216f26e72688171a0d15692cadf0d","time":"2024-09-11T12:33:40Z","line":"github.com/cs3org/reva/[email protected]/internal/http/interceptors/auth/auth.go:248","message":"core access token not set"}
storageusers-79c7b89d89-qk24z storageusers {"level":"info","service":"storage-users","pkg":"rhttp","traceid":"1f4db51e2f42ad445425c9ad7707ca8b","time":"2024-09-11T12:33:40Z","line":"github.com/cs3org/reva/[email protected]/internal/http/interceptors/auth/auth.go:195","message":"skipping auth check for: /data/tus/df1ea6c4-b70c-4766-a91c-db204956d847"}
storageusers-79c7b89d89-qk24z storageusers {"level":"warn","service":"storage-users","pkg":"rhttp","traceid":"1f4db51e2f42ad445425c9ad7707ca8b","time":"2024-09-11T12:33:40Z","line":"github.com/cs3org/reva/[email protected]/internal/http/interceptors/auth/auth.go:248","message":"core access token not set"}
proxy-c67d86f65-klxsc proxy {"level":"info","service":"proxy","proto":"HTTP/1.1","request-id":"5785b51d-9d5f-49c1-b988-8e613a895620","traceid":"ee8bf90c834865ad00673803fe43015c","remote-addr":"192.168.49.1","method":"HEAD","status":200,"path":"/data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzI2MTQ0MjM2LCJpYXQiOjE3MjYwNTc4MzYsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy9kZjFlYTZjNC1iNzBjLTQ3NjYtYTkxYy1kYjIwNDk1NmQ4NDcifQ.IS0F0XJqtwEmw99CiPLyfm4L-aOOZt8wutHJlAv68t8","duration":5.516209,"bytes":0,"time":"2024-09-11T12:33:40Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/middleware/accesslog.go:34","message":"access-log"}
frontend-74d884d78c-hztzx frontend {"level":"error","service":"frontend","pkg":"rhttp","traceid":"69d216f26e72688171a0d15692cadf0d","request-id":"5785b51d-9d5f-49c1-b988-8e613a895620","content-length":58994227,"transferred-bytes":0,"time":"2024-09-11T12:33:40Z","line":"github.com/cs3org/reva/[email protected]/internal/http/services/datagateway/datagateway.go:226","message":"content length vs transferred bytes mismatch"}
frontend-74d884d78c-hztzx frontend {"level":"info","service":"frontend","pkg":"rhttp","traceid":"e17aa51a462c137d8bca765df8ac894d","time":"2024-09-11T12:33:40Z","line":"github.com/cs3org/reva/[email protected]/internal/http/interceptors/auth/auth.go:195","message":"skipping auth check for: /data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzI2MTQ0MjM2LCJpYXQiOjE3MjYwNTc4MzYsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy9kZjFlYTZjNC1iNzBjLTQ3NjYtYTkxYy1kYjIwNDk1NmQ4NDcifQ.IS0F0XJqtwEmw99CiPLyfm4L-aOOZt8wutHJlAv68t8"}
frontend-74d884d78c-hztzx frontend {"level":"warn","service":"frontend","pkg":"rhttp","traceid":"e17aa51a462c137d8bca765df8ac894d","time":"2024-09-11T12:33:40Z","line":"github.com/cs3org/reva/[email protected]/internal/http/interceptors/auth/auth.go:248","message":"core access token not set"}
storageusers-79c7b89d89-qk24z storageusers {"level":"info","service":"storage-users","pkg":"rhttp","traceid":"ad25badc5d3584c553509994ee80c85f","time":"2024-09-11T12:33:40Z","line":"github.com/cs3org/reva/[email protected]/internal/http/interceptors/auth/auth.go:195","message":"skipping auth check for: /data/tus/df1ea6c4-b70c-4766-a91c-db204956d847"}
storageusers-79c7b89d89-qk24z storageusers {"level":"warn","service":"storage-users","pkg":"rhttp","traceid":"ad25badc5d3584c553509994ee80c85f","time":"2024-09-11T12:33:40Z","line":"github.com/cs3org/reva/[email protected]/internal/http/interceptors/auth/auth.go:248","message":"core access token not set"}
storageusers-79c7b89d89-qk24z storageusers {"level":"warn","service":"storage-users","pkg":"rhttp","traceid":"ad25badc5d3584c553509994ee80c85f","host":"10.244.10.205","method":"PATCH","uri":"/data/tus/df1ea6c4-b70c-4766-a91c-db204956d847","url":"/df1ea6c4-b70c-4766-a91c-db204956d847","proto":"HTTP/1.1","status":403,"size":54,"start":"11/Sep/2024:12:33:40 +0000","end":"11/Sep/2024:12:33:40 +0000","time_ns":163649,"time":"2024-09-11T12:33:40Z","line":"github.com/cs3org/reva/[email protected]/internal/http/interceptors/log/log.go:112","message":"http"}
proxy-c67d86f65-klxsc proxy {"level":"info","service":"proxy","proto":"HTTP/1.1","request-id":"5785b51d-9d5f-49c1-b988-8e613a895620","traceid":"a200678dd6ec088af1403e821f0914c6","remote-addr":"192.168.49.1","method":"PATCH","status":403,"path":"/data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzI2MTQ0MjM2LCJpYXQiOjE3MjYwNTc4MzYsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy9kZjFlYTZjNC1iNzBjLTQ3NjYtYTkxYy1kYjIwNDk1NmQ4NDcifQ.IS0F0XJqtwEmw99CiPLyfm4L-aOOZt8wutHJlAv68t8","duration":6.16426,"bytes":0,"time":"2024-09-11T12:33:40Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/middleware/accesslog.go:34","message":"access-log"}
frontend-74d884d78c-hztzx frontend {"level":"warn","service":"frontend","pkg":"rhttp","traceid":"e17aa51a462c137d8bca765df8ac894d","host":"10.244.10.196","method":"PATCH","uri":"/data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzI2MTQ0MjM2LCJpYXQiOjE3MjYwNTc4MzYsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy9kZjFlYTZjNC1iNzBjLTQ3NjYtYTkxYy1kYjIwNDk1NmQ4NDcifQ.IS0F0XJqtwEmw99CiPLyfm4L-aOOZt8wutHJlAv68t8","url":"/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzI2MTQ0MjM2LCJpYXQiOjE3MjYwNTc4MzYsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy9kZjFlYTZjNC1iNzBjLTQ3NjYtYTkxYy1kYjIwNDk1NmQ4NDcifQ.IS0F0XJqtwEmw99CiPLyfm4L-aOOZt8wutHJlAv68t8","proto":"HTTP/1.1","status":403,"size":0,"start":"11/Sep/2024:12:33:40 +0000","end":"11/Sep/2024:12:33:40 +0000","time_ns":1201665,"time":"2024-09-11T12:33:40Z","line":"github.com/cs3org/reva/[email protected]/internal/http/interceptors/log/log.go:112","message":"http"}

wkloucek avatar Sep 11 '24 12:09 wkloucek

Here a short script to create test files:

#!/bin/bash

TARGET_DIR=~/DemoFiles
mkdir -p "$TARGET_DIR"

FILE_COUNT=1000
MIN_SIZE=5120        # 5KB
MAX_SIZE=5368709120  # 5GB

STEP_SIZE=$(( (MAX_SIZE - MIN_SIZE) / (FILE_COUNT - 1) ))

for ((i=1; i<=FILE_COUNT; i++)); do
  FILE_SIZE=$(( MIN_SIZE + (i - 1) * STEP_SIZE ))
  FILE_NAME="$TARGET_DIR/file_$i.bin"
  head -c "$FILE_SIZE" </dev/urandom > "$FILE_NAME"
  echo "Created $FILE_NAME with size $FILE_SIZE bytes"
done

echo "All files created."

dj4oC avatar Sep 11 '24 12:09 dj4oC