WIP: Prevent breaking changes when using non-root container image for 2.9.0

[michaeljmarshall]

Fixes #110

Motivation

The 2.8.0 pulsar docker image defaults to run as user id 10000. This will break end user deployments unless we modify the helm chart.

Note, I have an outstanding question about how pulsar functions are deployed with this helm chart. I haven't used the helm chart to deploy functions, so I'm not sure what is required to ensure that functions work before and after the upgrade. We'll need to solve this before merging the PR.

Modifications

1. Run bookies as root by default.
2. Run zookeeper as root by default.
3. Update the proxy service to route traffic from port 80 to port 8080 by default.

Verifying this change

I deployed this change on a local minikube cluster to make sure things looked as expected. The bookies and zookeepers run as the root user, and the proxy service maps the port from 80 to 8080.

[michaeljmarshall]

@eolivelli and @addisonj - please take a look. I still have some questions, so I titled this PR as a WIP for now. Thanks.

[michaeljmarshall]

This is now targeting the 2.9.0 release. I am working on a doc that will help coordinate all of the work required to move pulsar to default to using non-root container images.

[michaeljmarshall]

We no longer need this PR since it was superseded by other work.