rubix
rubix copied to clipboard
qubole
Cache File System optimized for columnar formats and object stores
Kindly loosen restrictions on ClusterManager configuration such that a custom ClusterManager implementation can be provided via: rubix.custom.clustermanager.class=org.foo.bar.MyClusterManager Please see #154 which gives the impression of broader pluggability, but is only...
Rubix is not spelled consistently in the documentation. We should decide on a consistent spelling and update the docs accordingly.
18/12/28 13:29:50 INFO RetryingBookkeeperClient: Error while connecting : org.apache.thrift.shaded.TApplicationException: getCacheStatus failed: unknown result ... 18/12/28 13:29:50 INFO CachingInputStream: Could not get cache status from server org.apache.thrift.shaded.TException at com.qubole.rubix.spi.RetryingBookkeeperClient.retryConnection(RetryingBookkeeperClient.java:95) at com.qubole.rubix.spi.RetryingBookkeeperClient.getCacheStatus(RetryingBookkeeperClient.java:47)...
Current README has the following instructions > Add the Rubix jars to Driver and Executor classpaths and use the rubix implementation for hadoop.fs.s3 and hadoop.fs.s3n. --conf spark.hadoop.fs.s3.impl=com.qubole.rubix.hadoop2.CachingNativeS3FileSystem --conf spark.hadoop.fs.s3n.impl=com.qubole.rubix.hadoop2.CachingNativeS3FileSystem --conf...
