shark
shark copied to clipboard
This patch addresses two cache issues
trafficstars
- 'cache tablename' directive overwrites existing memory tables and can cause memory leaks when the cache command is used on an already cached table. caching new partition also causes a memory leak if the parition already exists.
- using 'cache' directive on a partitioned table causes table to be corrupt. Only the last cached partition is accessable with the rest being leaked.
@rxin - Please review.
Merged build triggered.
Merged build started.
#2 is actually a bug in SparkLoadTask#loadPartitionedMemoryTable(), I'll submit a fix in a bit
This should address it: https://github.com/amplab/shark/pull/296
Merged build finished.
All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/Shark-Pull-Request-Builder/12151/