dbt-duckdb icon indicating copy to clipboard operation
dbt-duckdb copied to clipboard

Published 20 hours ago • verified publisher icon duckdb

Bug:Running Incremental Model For nearly above half a millions of data

Open g-diwakar opened this issue 8 months ago • 5 comments

My pipeline was working fine for a month until the data volume reaches to like 50 million of rows. It then throws an error lilke this:

what(): {"exception_type":"INTERNAL","exception_message":"Attempted to access index 9223372036854775807 within vector of size 3"}

I first of all thought this error could be beacuse of the duckdb side but no.

There is no error when I am running the model with a full-refresh mode. But as soon as I run an incremental model I am encountered with such kind of error.

g-diwakar avatar Feb 12 '25 14:02 g-diwakar