Gijs Segerink

icon indicating a website link https://intelligencecompany.net icon indicating an email [email protected]

icon company Intelligence Company / De Data Engineers / TRUST AI icon location Netherlands icon location (AI/ML) Data Engineer & FullStack Software Developer (self employed) https://dedataengineers.nl https://intelligencecompany.net https://trust-ai.nl

Results 2 comments of Gijs Segerink

[BUG] Filters on partition columns don't work | Spark 3.3.1 | com.crealytics:spark-excel_2.12:3.3.1_0.18.5

I did a temp workaround to temporary save it as a parquet and reload the dataframe as soon as I want to apply a filter: df.Write() .Mode("overwrite") .Parquet($"xxx"); df.Unpersist(); df...

Store LanceDB on Storage Account

@microsoft-github-policy-service agree