hdfs-deprecated icon indicating copy to clipboard operation
hdfs-deprecated copied to clipboard

Dockerize the hdfs mesos framework to be able to schedule as docker on marathon/chronos

Open nigoel opened this issue 10 years ago • 7 comments

  1. Adding the hdfs-start.py - This calls the ./bin/hdfs-mesos, however expose the option to modify the given config file parameters with the run time arguments.
  2. Writing a docker file
  3. Executing the hdfs-start with the arguments passed while running the docker image.

nigoel avatar Aug 27 '15 07:08 nigoel

Docker can be found here https://hub.docker.com/r/nigoel/hdfs-mesos/

nigoel avatar Aug 31 '15 10:08 nigoel

There has been work on this done to pass the config values through environment variables, see https://github.com/mesosphere/hdfs/pull/123. How would you feel about basing your PR off of that implementation? It was almost finished, but we ran into some issues while testing. (cc @nicgrayson and @rubbish)

elingg avatar Sep 01 '15 23:09 elingg

Hi @elingg , Thanks for letting me know. I will check that.

nigoel avatar Sep 02 '15 04:09 nigoel

Thanks @nigoel

elingg avatar Sep 04 '15 17:09 elingg

@elingg Is there any near ETA when dockerization changes mentioned in #123 are going to be merged. The difference in my PR and the one you mentioned is that :- I provide the configuration as arguments and the other PR as environment variables. I am not sure whether my PR is still reasonable, if the change is already in progress. I just need a way to run the docker with dynamic way of providing the configuration (not burned in docker).

In my organization, I am working with the docker in this PR. But since this is not integrated with daily builds.. I am missing the upgrades. It would be helpful, if we can provide an ETA on dockerization changes in the mentioned PR #123

(cc @nicgrayson and @rubbish)

nigoel avatar Sep 11 '15 03:09 nigoel

I would prefer you built off #123 @nigoel. It was already reviewed and I am quite happy with the style. It would be a good starting point. I don't think @nicgrayson or @rubbish are working on it right now so you can pick up where they left off

elingg avatar Sep 12 '15 03:09 elingg

Please note that this repository is now deprecated. See this issue for a more detailed explanation.

triclambert avatar Sep 19 '16 17:09 triclambert