openaustralia
Massive amount of files being created in /var/log/upstart/
We discovered this because our Linode backups started failing. The helpful Linoders pointed out that backups can fail due to a really big number of files and that we have heaps in /var/lib/docker and /var/log/upstart.
We need the ones in /var/lib/docker and a quick check of /var/log/upstart showed millions of files like /var/log/upstart/network-interface-vethedb98ab.log. That made me think Docker was responsible and it looks like we're not the only ones affected: https://github.com/docker/docker/issues/3837
Not surprisingly I couldn't remove these with rm and a wildcard (the wildcard tries to put every file as an argument to rm) so I had to use:
find /var/log/upstart/ -name "network-interface-veth*" | xargs rm
However they're already filling up again so we'll need to fix this properly.
Summarising https://github.com/docker/docker/issues/3837, it's probably a bug in the ifupdown package which has been fixed. I don't know which version of ubuntu the fix has made it into. A workaround is to setup a logrotate on those files
