disabled_filesystems = 'LocalFileSystem' and ATTACH 'ducklake' don't work together
What happens?
I need to SET disabled_filesystems = 'LocalFileSystem' for security reasons, but this makes me unable to use Ducklake even when specifying an external catalog database and S3 storage
To Reproduce
> SET disabled_filesystems = 'LocalFileSystem';
> ATTACH 'ducklake:postgres:any_conn_str' AS d (DATA_PATH 's3://bucket/datalake');
>>> Permission Error:
>>> File system LocalFileSystem has been disabled by configuration
OS:
MacOS, Mac M4 (arm64)
DuckDB Version:
1.3.2
DuckDB Client:
CLI and duckdb-rs
Hardware:
No response
Full Name:
Diego Imbert
Affiliation:
Windmill
What is the latest build you tested with? If possible, we recommend testing with the latest nightly build.
I have not tested with any build
Did you include all relevant data sets for reproducing the issue?
No - Other reason (please specify in the issue body)
Did you include all code required to reproduce the issue?
- [x] Yes, I have
Did you include all relevant configuration (e.g., CPU architecture, Python version, Linux distribution) to reproduce the issue?
- [x] Yes, I have
Thanks! We are on it
hi @diegoimbert I've taken a look here and this issue has to do with the fact that the ducklake attach statement you specified requires the loading of at least 2 extensions: httpfs and postgres_scanner. The error is caused by these extensions being not loadable since you have forbidden the use of the local filesystem. Could you try loading the extensions for disabling the local filesystem?
LOAD httpfs;
LOAD postgres_scanner;
LOAD ducklake;
SET disabled_filesystems = 'LocalFileSystem';
ATTACH 'ducklake:postgres:any_conn_str' AS d (DATA_PATH 's3://bucket/datalake');
Should work I think
Hi @diegoimbert, feel free to reopen if that's still a problem.
Hello, sorry I forgot about this. Solution seems to work, thanks !