Fritz Larco
Fritz Larco
This is done. See https://blog.slingdata.io/efficient-data-lake-management-with-sling-and-delta-lake
Hi, `error during iteration in nextFunc` means error getting next record, so it's not a retry. Retries are in the works. Will inform you when ready!
Hi, so this is mostly already being done in the `$SLING_HOME_DIR/.sling.db` file (default for $SLING_HOME_DIR is `~/.sling`). It is however a SQLite file. You can see the `executions`, `tasks` &...
Ah ok. Interesting. Yes I'll do that. Although, you wouldn't be able to specify a different `DUCKDB_VERSION` then the one in the image. Plan is to make a `loaded` image:...
Hey @temminks, thanks for volunteering. As for your question, no, there aren't any pending dependencies that would block this. This one is a bit complex, as it involves breaking into...
@yokofly thanks, not working on this atm. Feel free to work on it. The [WriteToDB](https://github.com/slingdata-io/sling-cli/blob/main/core/sling/task_run_write.go#L133) would need to carefully be broken into pieces. Let me know if you have any...
Added in #410
Second option sounds good. 👍 Will put a warning, mentioning it's falling to using temp table (for `incremental`/`backfill` with PK)
[Done](https://github.com/slingdata-io/sling-cli/commit/270446a62c97946aaf49f84f3334e22a13849a19)
Thanks, adding some links: - https://github.com/apache/iceberg-go - https://pkg.go.dev/github.com/apache/arrow/go/[email protected] - https://github.com/apache/arrow/tree/main/go