hdfs-deprecated
hdfs-deprecated copied to clipboard
Dockerize the hdfs mesos framework to be able to schedule as docker on marathon/chronos
- Adding the hdfs-start.py - This calls the ./bin/hdfs-mesos, however expose the option to modify the given config file parameters with the run time arguments.
- Writing a docker file
- Executing the hdfs-start with the arguments passed while running the docker image.
Docker can be found here https://hub.docker.com/r/nigoel/hdfs-mesos/
There has been work on this done to pass the config values through environment variables, see https://github.com/mesosphere/hdfs/pull/123. How would you feel about basing your PR off of that implementation? It was almost finished, but we ran into some issues while testing. (cc @nicgrayson and @rubbish)
Hi @elingg , Thanks for letting me know. I will check that.
Thanks @nigoel
@elingg Is there any near ETA when dockerization changes mentioned in #123 are going to be merged. The difference in my PR and the one you mentioned is that :- I provide the configuration as arguments and the other PR as environment variables. I am not sure whether my PR is still reasonable, if the change is already in progress. I just need a way to run the docker with dynamic way of providing the configuration (not burned in docker).
In my organization, I am working with the docker in this PR. But since this is not integrated with daily builds.. I am missing the upgrades. It would be helpful, if we can provide an ETA on dockerization changes in the mentioned PR #123
(cc @nicgrayson and @rubbish)
I would prefer you built off #123 @nigoel. It was already reviewed and I am quite happy with the style. It would be a good starting point. I don't think @nicgrayson or @rubbish are working on it right now so you can pick up where they left off
Please note that this repository is now deprecated. See this issue for a more detailed explanation.