ducklake icon indicating copy to clipboard operation
ducklake copied to clipboard

DuckDB crashes when opening DuckLake - Data loaded via DBT

Open IS-Josh opened this issue 6 months ago • 0 comments

Data was loaded via DBT-DuckDB, with some tables having 2 level partitions.

I have tried loading data via DBT to both cloudflare R2 and GCP Cloud Storage. I've tried deleting the catalog and cloud storage field and starting again. Same issue occurs. When I try to load the ducklake, DuckDB crashes. I have no issues with another ducklake on r2 which I have only interacted with vi DuckDB UI

Catalog is hosted on postres (neon) Running on OSX 15.3.1 - M1 Mac

Running latest versions of duckb and nightly of ducklake

libc++abi: terminating due to uncaught exception of type duckdb::Exception: {"exception_type":"FATAL","exception_message":"Failed: database has been invalidated because of a previous fatal error. The database must be restarted prior to being used again.
Original error: \"Attempted to dereference shared_ptr that is NULL!\"

Stack Trace:

0        _ZN6duckdb9ExceptionC2ENS_13ExceptionTypeERKNSt3__112basic_stringIcNS2_11char_traitsIcEENS2_9allocatorIcEEEE + 64
1        _ZN6duckdb14FatalExceptionC1ENS_13ExceptionTypeERKNSt3__112basic_stringIcNS2_11char_traitsIcEENS2_9allocatorIcEEEE + 12
2        _ZN6duckdb12ErrorManager19InvalidatedDatabaseERNS_13ClientContextERKNSt3__112basic_stringIcNS3_11char_traitsIcEENS3_9allocatorIcEEEE + 172
3        _ZN6duckdb13ClientContext18BeginQueryInternalERNS_17ClientContextLockERKNSt3__112basic_stringIcNS3_11char_traitsIcEENS3_9allocatorIcEEEE + 980
4        _ZN6duckdb13ClientContext35PendingStatementOrPreparedStatementERNS_17ClientContextLockERKNSt3__112basic_stringIcNS3_11char_traitsIcEENS3_9allocatorIcEEEENS_10unique_ptrINS_12SQLStatementENS3_14default_deleteISD_EELb1EEERNS_10shared_ptrINS_21PreparedStatementDataELb1EEERKNS_22PendingQueryParametersE + 60
5        _ZN6duckdb13ClientContext43PendingStatementOrPreparedStatementInternalERNS_17ClientContextLockERKNSt3__112basic_stringIcNS3_11char_traitsIcEENS3_9allocatorIcEEEENS_10unique_ptrINS_12SQLStatementENS3_14default_deleteISD_EELb1EEERNS_10shared_ptrINS_21PreparedStatementDataELb1EEERKNS_22PendingQueryParametersE + 1556
6        _ZN6duckdb13ClientContext20PendingQueryInternalERNS_17ClientContextLockENS_10unique_ptrINS_12SQLStatementENSt3__114default_deleteIS4_EELb1EEERKNS_22PendingQueryParametersEb + 144
7        _ZN6duckdb13ClientContext5QueryERKNSt3__112basic_stringIcNS1_11char_traitsIcEENS1_9allocatorIcEEEEb + 268
8        _ZN6duckdb10Connection8RollbackEv + 68
9        _ZN6duckdb19DuckLakeTransaction8RollbackEv + 40
10       _ZN6duckdb26DuckLakeTransactionManager19RollbackTransactionERNS_11TransactionE + 36
11       duckdb::TransactionContext::Rollback(duckdb::optional_ptr<duckdb::ErrorData, true>) + 168
12       duckdb::ClientContext::Destroy() + 96
13       duckdb::ClientContext::~ClientContext() + 32
14       duckdb::Connection::~Connection() + 128
15       duckdb::DuckDBPyConnection::Close() + 80
16       void pybind11::cpp_function::initialize<pybind11::cpp_function::cpp_function<void, duckdb::DuckDBPyConnection, pybind11::name, pybind11::is_method, pybind11::sibling, char [21]>(void (duckdb::DuckDBPyConnection::*)(), pybind11::name const&, pybind11::is_method const&, pybind11::sibling const&, char const (&) [21])::'lambda'(duckdb::DuckDBPyConnection*), void, duckdb::DuckDBPyConnection*, pybind11::name, pybind11::is_method, pybind11::sibling, char [21]>(void&&, duckdb::DuckDBPyConnection (*)(), pybind11::name const&, pybind11::is_method const&, pybind11::sibling const&, char const (&) [21])::'lambda'(pybind11::detail::function_call&)::__invoke(pybind11::detail::function_call&) + 112
17       pybind11::cpp_function::dispatcher(_object*, _object*, _object*) + 3664
18       cfunction_call + 60
19       _PyObject_MakeTpCall + 128
20       _PyEval_EvalFrameDefault + 53588
21       gen_send_ex2 + 204
22       _gen_throw + 336
23       _PyEval_EvalFrameDefault + 63392
24       _PyEval_Vector + 156
25       method_vectorcall + 296
26       _PyEval_EvalFrameDefault + 48944
27       gen_send_ex2 + 204
28       _gen_throw + 336
29       _PyEval_EvalFrameDefault + 63392
30       _PyEval_Vector + 156
31       method_vectorcall + 296
32       _PyEval_EvalFrameDefault + 48944
33       _PyEval_Vector + 156
34       _PyEval_EvalFrameDefault + 63912
35       _PyEval_Vector + 156
36       _PyEval_EvalFrameDefault + 63912
37       _PyEval_Vector + 156
38       method_vectorcall + 364
39       thread_run + 220
40       pythread_wrapper + 48
41       _pthread_start + 136
42       thread_start + 8
","stack_trace":""}

IS-Josh avatar May 31 '25 08:05 IS-Josh