dlt icon indicating copy to clipboard operation
dlt copied to clipboard

truncate the staging dataset tables after load

Open rudolfix opened this issue 11 months ago • 0 comments

Feature description

I want to free space in the staging dataset and truncate the tables after load

Are you a dlt user?

Yes, I'm already a dlt user.

Use case

No response

Proposed solution

We can reuse the storage init method in the loader and run the truncation again after the load is fully completed. this is done on best effort basis and should not fail the overall load

Related issues

No response

rudolfix avatar Mar 18 '24 14:03 rudolfix