EJ Song
EJ Song
I didn't write a design doc & issue since it's straightforward. Please let me know if we need a design documentation.
@vkorukanti Could you review the PR when you have the time? TIA!
@zsxwing Could you review the PR? Thanks!
You can check the result after setting "Pages" branch/directory in your repository. Setting -> Pages -> setting source as the branch & "/docs", then you can see your change in...
Actually I doubt the usability of this feature.. What if a user tires to refresh index with `hs.refreshIndex("index", "incremental", Some("data/y=2020/*"))` after `hs.refreshIndex("index", "incremental", Some("data/y=2021/*"))` ? To apply the index, a...
Thanks for initiating this issue! I'm good with those suggestions. :)
Generally LGTM! How about `includeColumns` `excludeColumns` rather than `mode` + `columns`? I wonder incremental refresh will work well with the previous data. Could you create a prototype PR?
``` def refreshIndex( indexName: String, mode: String, includedColumns: IncludedColumns, // optional, used if change needed in current included columns schema: StructType // optional, used if includedColumns.include is non-empty ) ```...
Looks good to me! Could you update the PR accordingly? Btw, if you get a chance, could you check if BHJ removal condition works for upper layer joins ? (one...
@pirz Could you create a new issue for determining createIndex / refershIndex APIs for other index types & exclude/include columns? We discussed some for that, but there's no issue for...