hdfs-du
hdfs-du copied to clipboard
Modified the example.txt to show more colorization in the demo.
This pull request fails (merged 3e53700c into 5caaa0cf).
Thanks for the pull request, we can definitely improve the example data set.
Can you try the following and let me know what you think? What's interesting about this data set is that when you initially load the page you won't even see "baz", since its quite small and the default view is file size. But when you switch to file count it really jumps out. This highlights how the tool helps find inefficient data sets that might not be on the radar since they're not taking up a lot of physical storage space, but are taking up a lot of NN heap.
/ 2010000000 21 0 /foo 1000000000 1 0 /foo/foo0 1000000000 1 1 /bar 1000000000 10 0 /bar/bar0 100000000 1 1 /bar/bar1 100000000 1 1 /bar/bar2 100000000 1 1 /bar/bar3 100000000 1 1 /bar/bar4 100000000 1 1 /bar/bar5 100000000 1 1 /bar/bar6 100000000 1 1 /bar/bar7 100000000 1 1 /bar/bar8 100000000 1 1 /bar/bar9 100000000 1 1 /baz 10000000 10 0 /baz/baz0 1000000 1 1 /baz/baz1 1000000 1 1 /baz/baz2 1000000 1 1 /baz/baz3 1000000 1 1 /baz/baz4 1000000 1 1 /baz/baz5 1000000 1 1 /baz/baz6 1000000 1 1 /baz/baz7 1000000 1 1 /baz/baz8 1000000 1 1 /baz/baz9 1000000 1 1
This data causes a failure in mvn test for me. Also, my pull request seems to have failed because it's trying to compile against a version of java before generics were introduced.
- Ryan
On Wed, Sep 5, 2012 at 8:47 AM, Travis Crawford [email protected]:
Thanks for the pull request, we can definitely improve the example data set.
Can you try the following and let me know what you think? What's interesting about this data set is that when you initially load the page you won't even see "baz", since its quite small and the default view is file size. But when you switch to file count it really jumps out. This highlights how the tool helps find inefficient data sets that might not be on the radar since they're not taking up a lot of physical storage space, but are taking up a lot of NN heap.
/ 2010000000 21 0 /foo 1000000000 1 0 /foo/foo0 1000000000 1 1 /bar 1000000000 10 0 /bar/bar0 100000000 1 1 /bar/bar1 100000000 1 1 /bar/bar2 100000000 1 1 /bar/bar3 100000000 1 1 /bar/bar4 100000000 1 1 /bar/bar5 100000000 1 1 /bar/bar6 100000000 1 1 /bar/bar7 100000000 1 1 /bar/bar8 100000000 1 1 /bar/bar9 100000000 1 1 /baz 10000000 10 0 /baz/baz0 1000000 1 1 /baz/baz1 1000000 1 1 /baz/baz2 1000000 1 1 /baz/baz3 1000000 1 1 /baz/baz4 1000000 1 1 /baz/baz5 1000000 1 1 /baz/baz6 1000000 1 1 /baz/baz7 1000000 1 1 /baz/baz8 1000000 1 1 /baz/baz9 1000000 1 1
— Reply to this email directly or view it on GitHubhttps://github.com/twitter/hdfs-du/pull/5#issuecomment-8303480.
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
You have signed the CLA already but the status is still pending? Let us recheck it.