Josh Wills

Results 174 comments of Josh Wills

> So, I added the structure and will start with the simple implementation of the native plugin, which will hopefully show if this makes sense. > > This is still...

Hey Nat-- no, all we do [here](https://github.com/duckdb/dbt-duckdb/blob/master/setup.py#L41) is specify a minimum DuckDB version (currently 0.7.0); you should be able to use any DuckDB version greater than that with the 1.7.x...

@milicevica23 ah that is very cool, thanks for the update! I have some stuff going on this week but I will dive into this on Thursday!

@milicevica23 when you get a chance could you redo the formatting according to the `pre-commit run --all-files` setup? All of the formatting diffs make this hard to review

Hey @jaanli, thanks for the nice note and for the teaching you do! So I cloned and ran the project you linked to locally without any issues afaict: ``` jwills@Joshs-MBP...

Yeah, I noticed that your default [materialization](https://docs.getdbt.com/docs/build/materializations) in the project was set to the dbt default, which is a `view`. That explains the small size of the DuckDB file you're...

Mmm, okay-- still guessing here, but I'd be suspicious of the `ignore_errors=True` line in the read_csv config in this model (assuming that this is upstream of whatever the `service_requests` model...

Mmm I've started working on iceberg as a source using an AWS catalog here via a plugin mechanism: https://github.com/jwills/dbt-duckdb/blob/master/dbt/adapters/duckdb/plugins/iceberg.py and then used here like this: https://github.com/jwills/dbt-duckdb/blob/master/tests/functional/plugins/test_iceberg.py ...but it's still pretty...

Okay-- so in theory, this will work: 1. pip3 install pyiceberg[glue,s3fs,pyarrow] 2. pip3 install git+https://github.com/jwills/dbt-duckdb.git (b/c I haven't cut a release with this functionality enabled yet) 3. Setup the environment...

ooh, that is nice syntax-- will do!