remove middleware-logger by default in next major

[Fishrock123]

To not include it you also need to concretely specify the other features, which isn't always desirable