cloud-pipeline
cloud-pipeline copied to clipboard
Logs rotation for services
Background
Currently, inner services used by Cloud Pipeline (EDGE and DAV) generate lots of different logs.
These logs are useful, but as these logs are storing in the core platform filesystem, we can face a problem when there are too many logs accumulated - and these logs can occupied significant portion of the filesystem, that in turn can lead to the global platform outage due to overconsumption.
We shall implement an overaccumulation protection for such logs.
Approach
Add an ability of logs rotation for EDGE and DAV services - these logs shall be automatically cleaned up when logs' age is greater than specific time period (in days):
- only logs, which are too old (older then specific period) shall be removed