Fritz Larco

Results 128 comments of Fritz Larco

This is done. See https://blog.slingdata.io/efficient-data-lake-management-with-sling-and-delta-lake

Hi, `error during iteration in nextFunc` means error getting next record, so it's not a retry. Retries are in the works. Will inform you when ready!

Hi, so this is mostly already being done in the `$SLING_HOME_DIR/.sling.db` file (default for $SLING_HOME_DIR is `~/.sling`). It is however a SQLite file. You can see the `executions`, `tasks` &...

Ah ok. Interesting. Yes I'll do that. Although, you wouldn't be able to specify a different `DUCKDB_VERSION` then the one in the image. Plan is to make a `loaded` image:...

Hey @temminks, thanks for volunteering. As for your question, no, there aren't any pending dependencies that would block this. This one is a bit complex, as it involves breaking into...

@yokofly thanks, not working on this atm. Feel free to work on it. The [WriteToDB](https://github.com/slingdata-io/sling-cli/blob/main/core/sling/task_run_write.go#L133) would need to carefully be broken into pieces. Let me know if you have any...

Second option sounds good. 👍 Will put a warning, mentioning it's falling to using temp table (for `incremental`/`backfill` with PK)

[Done](https://github.com/slingdata-io/sling-cli/commit/270446a62c97946aaf49f84f3334e22a13849a19)

Thanks, adding some links: - https://github.com/apache/iceberg-go - https://pkg.go.dev/github.com/apache/arrow/go/[email protected] - https://github.com/apache/arrow/tree/main/go