hdfs-deprecated
hdfs-deprecated copied to clipboard
Published
20 hours ago •
mesosphere-backup
mesosphere-backup
Remove/reduce build dependency on hadoop-commons
Looks like SchedulerConf is bloating the build with all of hadoop-commons just for a few classes.
$ grep -rn "org.apache.hadoop" src/
src/main/java/org/apache/mesos/hdfs/config/SchedulerConf.java:4:import org.apache.hadoop.conf.Configuration;
src/main/java/org/apache/mesos/hdfs/config/SchedulerConf.java:5:import org.apache.hadoop.conf.Configured;
src/main/java/org/apache/mesos/hdfs/config/SchedulerConf.java:6:import org.apache.hadoop.fs.Path;
src/test/java/org/apache/mesos/hdfs/TestScheduler.java:4:import org.apache.hadoop.conf.Configuration;
We should investigate if this dependency is really necessary, and if so, if there are ways we can further reduce our build size, based on the minimal dependence on Hadoop. Maybe some compiler flags?
