Paola Pardo

Results 73 comments of Paola Pardo

I put you both @Jiaweihu08 and @polsm91 as reviewers to give me feedback if you can :) If you need an explanation on something, please let me know.

Changes explained: - `IndexedTable` would have a `.compact() `method that would follow the same pipeline as the write: Compact data (group info into "bins" for each cube), write data, and...

Thank you, @eavilaes , for noticing! Once we finish with the #116 PR, we will get hands-on with it. As you have guessed, we need some kind of support for...

Hi @eavilaes ! I have done a potential workaround on this issue. A lot of things need to be re-worked; it's still a **WIP**. But due to timing, you can...

## UPDATES Recently, we have been testing **if `QbeastCatalog` could coexist with other catalogs such as `DeltaCatalog` or `HoodieCatalog` or Iceberg's `SparkSessionCatalog`**. The short answer is yes and no. -...

Since we want the Catalog implementation to be independent of underlying formats, we decided to **extend `CatalogExtenssion` (option 2).** To implement all the methods required (listNamespaces(), listTables()...), **we will use...

Made some changes in the test, hope the Codecov report is satisfied this time hehe.

If you approve the change of versions @polsm91 @eavilaes , I will merge it immediately and you could check any incompatibility if you want :+1:

> Some versions still need to be changed (These are some of them, maybe do a _find all_): > > This block references Spark 3.1 and Hadoop 3.2: > >...