Paola Pardo
Paola Pardo
I put you both @Jiaweihu08 and @polsm91 as reviewers to give me feedback if you can :) If you need an explanation on something, please let me know.
Changes explained: - `IndexedTable` would have a `.compact() `method that would follow the same pipeline as the write: Compact data (group info into "bins" for each cube), write data, and...
Thank you, @eavilaes , for noticing! Once we finish with the #116 PR, we will get hands-on with it. As you have guessed, we need some kind of support for...
Hi @eavilaes ! I have done a potential workaround on this issue. A lot of things need to be re-worked; it's still a **WIP**. But due to timing, you can...
## UPDATES Recently, we have been testing **if `QbeastCatalog` could coexist with other catalogs such as `DeltaCatalog` or `HoodieCatalog` or Iceberg's `SparkSessionCatalog`**. The short answer is yes and no. -...
Since we want the Catalog implementation to be independent of underlying formats, we decided to **extend `CatalogExtenssion` (option 2).** To implement all the methods required (listNamespaces(), listTables()...), **we will use...
Made some changes in the test, hope the Codecov report is satisfied this time hehe.
We can fix this with #44
If you approve the change of versions @polsm91 @eavilaes , I will merge it immediately and you could check any incompatibility if you want :+1:
> Some versions still need to be changed (These are some of them, maybe do a _find all_): > > This block references Spark 3.1 and Hadoop 3.2: > >...