EJ Song
EJ Song
> Maybe there is one already? Maybe this one? https://microsoft.github.io/hyperspace/docs/toh-indexes-on-the-lake/ I think it's good to add this link to quick-start guide for reference.
@Neoix, it depends only for the default value. You can change the path under any other storage. EDIT: Note that the config should be set before creating Hyperspace object. Example:...
Hi @richiesgr, we cannot support Databricks runtime completely as they use their custom Spark version. As Hyperspace implementation is tightly coupled with the internal spark codebase, we cannot fix the...
Looks good! Could you also consider `df.filter(df("nested.nst.field1") === "wa1").select("id", "name", "nested.nst.fieldId1")` ? We might need to replace all "nested#102.nst.field1" in upper level of the tree plan, not just in (Project...
@andrei-ionescu I think the problem is that canonicalized value of condition left is `none#556`, not `none#536` Could you try to fix canonicalization of the condition expr properly (*if possible*), instead...
Based on the field name might cause some confusion/problem if there are same column names on both left and right. So I think we should keep trying use the id.
I'll update the document when I go through #161. Thanks!
@panish-git Could you check if delta dependency is added properly and also try to test using delta 0.8.0?
BTW thanks for the great work! and sorry for the delay in reviewing.. 🐢🦥 I'll try to do the review asap.
Could you add logical/spark plan change in the PR description? I'd like to see the plan of join query + filter index for one child. e.g. ``` val filter =...