Lorenzo Mangani

Humble weekend update @samansmink @carlopi ~~So far I couldn't find a clean way to integrate the duckdb buffer_manager lightly and more importantly I did not find a method to hook...

First of all thank you @carlopi for taking the time & buona domenica! 👋 > Or possibly even better as it's done in the S3FileHandle: Right. I've attempted the exact...

@carlopi I redefined `HTTPFileHandle::~HTTPFileHandle() ` as you suggested and the try/catch is entered but [void HTTPFileSystem::Close(FileHandle &handle)](https://github.com/lmangani/duckdb/blob/http-writer/extension/httpfs/httpfs.cpp#L674) is never triggered. By exclusion I guess this is an error in the...

bingo @carlopi I owe you a sunday lunch 😆 ```sql D SET enable_http_write = 1; D COPY (SELECT * as number, uuid() FROM generate_series(0,2999)) TO 'https://urleng.fly.dev/test.parquet'; D SELECT count() FROM...

🧪 Linking a simple [gist](https://gist.github.com/lmangani/723675a718ffb19d5f8e03f4154b33bb) with a [stand-alone python demo backend](https://gist.github.com/lmangani/723675a718ffb19d5f8e03f4154b33bb) to demonstrate R/W capabilities for CI/etc

> I guess remaning questions are: how this behave on failures? Say table generates a lot of data and then fail, is state carried over to next request? Or stuff...

> I was too thinking about `uuid`s for testing, since you can then do something like: > > * write uuids to table > * copy table over http >...

Hello @carlopi @samansmink 👋 Out of curiosity while waiting for a review and plans... is there any potential way for "features" such as this one to be released as an...

> Update: this took a bit due to various stuff that needed to come in first, but HTTPFS extension has been moved out of core, see #14727 and https://github.com/duckdb/duckdb_httpfs/tree/refs/heads/next. >...

@samansmink thanks but I'm not sure I understand where the complexity is. I followed all the indications provided but of course, testing would require some type of backend for a...