Harmonize `cache` dependencies

[simonsan]

We pull in cached and quick_cache. cached basically gives a very convenient macro to use which we only use to cache uid/gid to names mappings. But we maybe able to replace it with quick_cache or vice versa. In general, it should be fine to use a single implementation for caching and don't pull in as much dependencies.