Chungmin Lee
Chungmin Lee
Is there a reason that we can't bump the patch version? I quickly checked and there was only one breaking test. Seems not serious.
### What is the context for this pull request? - **Tracking Issue**: If you expect any [subjective discussions](https://google.github.io/eng-practices/review/developer/small-cls.html) around this pull request, please consider opening a tracking issue and link...
## Problem Statement Add support for data skipping indexes. ## Background and Motivation Hyperspace has been supporting hash-partitioned covering indexes only. Covering indexes are good for some workloads, but we...
### What is the context for this pull request? - **Tracking Issue**: #440 - **Parent Issue**: N/A - **Dependencies**: N/A ### What changes were proposed in this pull request? Update...
Here's the logs: https://dev.azure.com/ossspark/78bda1b1-2d15-4e6d-8327-a916f6cb1f9f/_apis/build/builds/2223/logs/48 Newly added tests are failing only for Windows / Spark 3.1. The exception is: `java.lang.UnsatisfiedLinkError: org.apache.hadoop.io.nativeio.NativeIO$POSIX.stat(Ljava/lang/String;)Lorg/apache/hadoop/io/nativeio/NativeIO$POSIX$Stat;` I suspect this is because Spark 3.1 depends on Hadoop...
### Describe the issue Results change after Hyperspace is enabled. ### To Reproduce ```scala import com.microsoft.hyperspace._ import com.microsoft.hyperspace.index._ spark.range(1000).toDF("A").write.parquet("X") val df = spark.read.parquet("X") val hs = Hyperspace() hs.createIndex(df, IndexConfig("myind", Seq("A"),...
Up to v0.4.0, users can create a single type of index using `IndexConfig`. We are adding more index types. When there are multiple index types, `IndexConfig` can be confusing to...
We're already doing it for scalastyle. Doing it also for scalafmt would be nice as we've seen many instances where inadvertent formatting changes distracting code reviews.
Forked from #399. Maybe a super nit issue 😉 I'm okay with any options, but they should be applied consistently. Identified inconsistencies during the review: - Starting a description for...
Fixes #271. With newly added classes for fingerprinting, now it is easy to make a fingerprint from various types of data. FingerprintBuilder can be used to build a fingerprint from...