hadoop-test-cluster
hadoop-test-cluster copied to clipboard
Dockerized setup for testing code on realistic hadoop clusters
Hi, I'm trying to build the docker image locally, slightly modified to test the following hdfs-site.xml configuration (for https://github.com/intake/filesystem_spec/pull/236) : ``` dfs.http.policy HTTPS_ONLY ``` However the build fails at the...
Hey @jcrist , Would you review and ultimately accept a PR that added Livy server to this hadoop stack?
This PR starts the MapReduce History Server and opens ports on master It should fix tests in this PR in skein https://github.com/jcrist/skein/pull/197 As htcluster command seems to pull docker image....
Can I release this on conda-forge?