Daniel Tomes

Wondering if drunken data quality would be a fit here. This might allow us to accomplish two goals, integrate python wrapper AND enable prebuilt rules written in drunken data quality...

@sundarshankar89 -- I dunno what's going on but I'm seeing 4 tests failing now on branch `pipelineFunctionTest`

Note @sundarshankar89 and @souravbaner-da -- some of the tests pass when run inside of IntelliJ but fail on `sbt clean assembly` please validate both.

Will investigate as a P1 to see if this is feasible in 0.6.1.2 but very likely may require significant schema changes which would push this back to 0.6.2.0

costing details in #398

Brainstorming notes on methodology 

Under utilization can be determine with a query. @mohanbaabu1996 -- please provide the query. Ganglia is going away to be replaced with better more modern tools; as such, we will...

@SomanathSankaran -- I realize the info above looks intimidating. Please note that we are working diligently to publish several of the more complicated queries, cluster utilization by hour is one...

@sundarshankar89 -- wasn't it you that said you were going to try to take a look at Sawan's PR and help close it? If not, sorry we can cover in...

Actually, upon further review, we're trying to locate that for you. We have engaged our internal teams to determine if it's being delivered, if it is not, they will need...