opendata.cern.ch
opendata.cern.ch copied to clipboard
devops: ship logs to central monitoring
Instead of OpenShift volatile storage, use central monitoring for logs.
Implement 3-month retention as per OC11.
If we would use the new Invenio Helm we would get a Logstash instance instance inside the cluster and its configuration ready. The logs would be shipped from the application to logstash through a filebeat sidecar.
The sidecar that Diego mentioned is in place for the nginx logs. Note that the output of the containers is also sent to the central monitoring by our openshift colleagues. Therefore, I have the feeling that this ticket can be closed