Failure to delete large project

[pombredanne]

I have a project with about 1M files and 2GB compressed inputs (~10G uncompressed) Deleting failed now and then with a "Gateway timeout" error

[pombredanne]

This happens also when deleting many projects. "504 Gateway Time-out nginx/1.19.6"

I would suggest that the deletion should happen in two steps:

1. the project is marked for deletion and the UI returns immediately. The project is hidden from the UI
2. there is a background task spawned for each project to delete. If it succeeds, the project record is deleted. If it fails, the project deletion marker is reset and the projects errors are updated with the project errors (or a banner is display with the error, like when a project has no longer its backing files)

[pombredanne]

Note that things work fine from the command line.

[jayanth-kumar-morem]

Working on this