rucio icon indicating copy to clipboard operation
rucio copied to clipboard
verified publisher icon rucio

`attach_dids` and `list-dataset-replicas` returns http 413 for large requests

Open haozturk opened this issue 1 year ago • 2 comments

Description

attach_dids returned this error when we tried to attach ~8k dids into a container. Details:

  • https://github.com/dmwm/WMCore/issues/11994

list-dataset-replicas had this issue for a container with 25k datasets attached to it (125532 files) Details:

  • https://github.com/dmwm/CMSRucio/issues/681

Steps to reproduce

Try to attach ~8k dids to a container or run list-dataset-replicas for a very large container

Rucio Version

Client: 32.3.1 - Server: 34.2.0

Additional Information

I used the client version 32.3.1 while getting the error with list-dataset-replicas. I'll let @amaltaro to comment which client is used while getting the issue with attach_dids, although probably this issue is not related to the client.

haozturk avatar May 23 '24 13:05 haozturk

@labkode suspects this is an ingress issue. Being followed up.

bari12 avatar May 24 '24 14:05 bari12

Confirmed is an issue with infra (nginx ingress) for the list-dataset-replicas call. Still to verify the other one (attach_dids)

labkode avatar May 28 '24 11:05 labkode