cloud-pipeline icon indicating copy to clipboard operation
cloud-pipeline copied to clipboard

Logs rotation for services

Open NShaforostov opened this issue 3 years ago • 0 comments

Background

Currently, inner services used by Cloud Pipeline (EDGE and DAV) generate lots of different logs. These logs are useful, but as these logs are storing in the core platform filesystem, we can face a problem when there are too many logs accumulated - and these logs can occupied significant portion of the filesystem, that in turn can lead to the global platform outage due to overconsumption. We shall implement an overaccumulation protection for such logs.

Approach

Add an ability of logs rotation for EDGE and DAV services - these logs shall be automatically cleaned up when logs' age is greater than specific time period (in days):

  • only logs, which are too old (older then specific period) shall be removed

NShaforostov avatar Aug 25 '22 12:08 NShaforostov