Fedir Skitsko

Results 74 comments of Fedir Skitsko

> > @XBeg9 are you sure you're not legitimately running out of memory? That `(403.0 GiB/403.0 GiB used)` doesn't seem suggestive of memory fragmentation (which I assume is the cause...

```sql SET threads TO 32; SET memory_limit = '256GB'; SET temp_directory='/mnt/data/tmp'; SELECT * FROM read_json_auto('companies/*.json', union_by_name=True); 0% ▕ ▏ Out of Memory Error: could not allocate block of size 32.0...

> > > I have 512gb RAM with 64CPU and dataset in gziped json format ~300gb raises exactly same error, rerun script 3 times and same issue. Reducing `thread` or...

@nikgraf any luck to check it so far? Thanks.

@nikgraf no problem, but you've merged this https://github.com/serverless/serverless-babel-plugin/pull/6 which was duplicate functionality of my PR. (btw that PR doesn't work for me)

Same here, I was unable to find the arm64 image for kanister, am I missing something or it's still in development?

> My biggest issue with delta lake is that they typically only support unity catalog and no instructions to storage on s3 compared to iceberg or hudi. Hi, not sure...

> > Spark-delta is. Delta-rs isn't > > It's more of the delta lake core project itself. Maybe the delta lake integrations have more diversity, like you mentioned. Thank you...