ducklake
ducklake copied to clipboard
DuckDB crashes when opening DuckLake - Data loaded via DBT
Data was loaded via DBT-DuckDB, with some tables having 2 level partitions.
I have tried loading data via DBT to both cloudflare R2 and GCP Cloud Storage. I've tried deleting the catalog and cloud storage field and starting again. Same issue occurs. When I try to load the ducklake, DuckDB crashes. I have no issues with another ducklake on r2 which I have only interacted with vi DuckDB UI
Catalog is hosted on postres (neon) Running on OSX 15.3.1 - M1 Mac
Running latest versions of duckb and nightly of ducklake
libc++abi: terminating due to uncaught exception of type duckdb::Exception: {"exception_type":"FATAL","exception_message":"Failed: database has been invalidated because of a previous fatal error. The database must be restarted prior to being used again.
Original error: \"Attempted to dereference shared_ptr that is NULL!\"
Stack Trace:
0 _ZN6duckdb9ExceptionC2ENS_13ExceptionTypeERKNSt3__112basic_stringIcNS2_11char_traitsIcEENS2_9allocatorIcEEEE + 64
1 _ZN6duckdb14FatalExceptionC1ENS_13ExceptionTypeERKNSt3__112basic_stringIcNS2_11char_traitsIcEENS2_9allocatorIcEEEE + 12
2 _ZN6duckdb12ErrorManager19InvalidatedDatabaseERNS_13ClientContextERKNSt3__112basic_stringIcNS3_11char_traitsIcEENS3_9allocatorIcEEEE + 172
3 _ZN6duckdb13ClientContext18BeginQueryInternalERNS_17ClientContextLockERKNSt3__112basic_stringIcNS3_11char_traitsIcEENS3_9allocatorIcEEEE + 980
4 _ZN6duckdb13ClientContext35PendingStatementOrPreparedStatementERNS_17ClientContextLockERKNSt3__112basic_stringIcNS3_11char_traitsIcEENS3_9allocatorIcEEEENS_10unique_ptrINS_12SQLStatementENS3_14default_deleteISD_EELb1EEERNS_10shared_ptrINS_21PreparedStatementDataELb1EEERKNS_22PendingQueryParametersE + 60
5 _ZN6duckdb13ClientContext43PendingStatementOrPreparedStatementInternalERNS_17ClientContextLockERKNSt3__112basic_stringIcNS3_11char_traitsIcEENS3_9allocatorIcEEEENS_10unique_ptrINS_12SQLStatementENS3_14default_deleteISD_EELb1EEERNS_10shared_ptrINS_21PreparedStatementDataELb1EEERKNS_22PendingQueryParametersE + 1556
6 _ZN6duckdb13ClientContext20PendingQueryInternalERNS_17ClientContextLockENS_10unique_ptrINS_12SQLStatementENSt3__114default_deleteIS4_EELb1EEERKNS_22PendingQueryParametersEb + 144
7 _ZN6duckdb13ClientContext5QueryERKNSt3__112basic_stringIcNS1_11char_traitsIcEENS1_9allocatorIcEEEEb + 268
8 _ZN6duckdb10Connection8RollbackEv + 68
9 _ZN6duckdb19DuckLakeTransaction8RollbackEv + 40
10 _ZN6duckdb26DuckLakeTransactionManager19RollbackTransactionERNS_11TransactionE + 36
11 duckdb::TransactionContext::Rollback(duckdb::optional_ptr<duckdb::ErrorData, true>) + 168
12 duckdb::ClientContext::Destroy() + 96
13 duckdb::ClientContext::~ClientContext() + 32
14 duckdb::Connection::~Connection() + 128
15 duckdb::DuckDBPyConnection::Close() + 80
16 void pybind11::cpp_function::initialize<pybind11::cpp_function::cpp_function<void, duckdb::DuckDBPyConnection, pybind11::name, pybind11::is_method, pybind11::sibling, char [21]>(void (duckdb::DuckDBPyConnection::*)(), pybind11::name const&, pybind11::is_method const&, pybind11::sibling const&, char const (&) [21])::'lambda'(duckdb::DuckDBPyConnection*), void, duckdb::DuckDBPyConnection*, pybind11::name, pybind11::is_method, pybind11::sibling, char [21]>(void&&, duckdb::DuckDBPyConnection (*)(), pybind11::name const&, pybind11::is_method const&, pybind11::sibling const&, char const (&) [21])::'lambda'(pybind11::detail::function_call&)::__invoke(pybind11::detail::function_call&) + 112
17 pybind11::cpp_function::dispatcher(_object*, _object*, _object*) + 3664
18 cfunction_call + 60
19 _PyObject_MakeTpCall + 128
20 _PyEval_EvalFrameDefault + 53588
21 gen_send_ex2 + 204
22 _gen_throw + 336
23 _PyEval_EvalFrameDefault + 63392
24 _PyEval_Vector + 156
25 method_vectorcall + 296
26 _PyEval_EvalFrameDefault + 48944
27 gen_send_ex2 + 204
28 _gen_throw + 336
29 _PyEval_EvalFrameDefault + 63392
30 _PyEval_Vector + 156
31 method_vectorcall + 296
32 _PyEval_EvalFrameDefault + 48944
33 _PyEval_Vector + 156
34 _PyEval_EvalFrameDefault + 63912
35 _PyEval_Vector + 156
36 _PyEval_EvalFrameDefault + 63912
37 _PyEval_Vector + 156
38 method_vectorcall + 364
39 thread_run + 220
40 pythread_wrapper + 48
41 _pthread_start + 136
42 thread_start + 8
","stack_trace":""}