Rajat Venkatesh
Rajat Venkatesh
As per https://docs.oracle.com/javase/6/docs/technotes/guides/jdbc/getstart/mapping.html, `Types.DECIMAL` should be mapped to `java.math.BigDecimal`. However, AggStar rule fails because Double and BigDecimal are not considered to be equivalent. The relevant stack trace is: ``` java.lang.AssertionError:...
Current README has the following instructions > Add the Rubix jars to Driver and Executor classpaths and use the rubix implementation for hadoop.fs.s3 and hadoop.fs.s3n. --conf spark.hadoop.fs.s3.impl=com.qubole.rubix.hadoop2.CachingNativeS3FileSystem --conf spark.hadoop.fs.s3n.impl=com.qubole.rubix.hadoop2.CachingNativeS3FileSystem --conf...
Parts of Rubix are compiled with other projects like Presto and Hadoop. Some changes break compilation and are discovered much later. A test framework is required which compiles the jars...
#139 is adding a basic health check for every Rubix daemon. The health check should be expanded such that it aggregates health checks of all components. A couple of components...
Metrics captures only local reads and remote reads. Add a metric to also capture non-local reads.
In README and docs, have a section on resources that point to blog posts and slide decks. Docs should be more comprehensive.
Current README has the following markdown: ### Supported Engines and Cloud Stores - Presto: Amazon S3 - Spark: Amazon S3 - Any engine using hadoop-2 or hadoop-1, e.g. Hive can...
Current README has the following markdown text: ### Monitoring Client side monitoring is set up right now, stats are published to MBean named `rubix:name=stats` Engines which provide interface to view...
@wishnick's experiments have thrown up an interesting dependence between ratio of local/non-local reads relative to the cluster size. We have not studied the effect of cluster size on these metrics....
Historically we have focussed on the performance comparison of local and remote reads. Non-local reads are an important mode especially in large clusters. Study the performance of non-local reads and...