dlt
dlt copied to clipboard
add filesystem copy helper
Description
This PR implements a copy / import helper for the filesystem. When used, all files iterated by the filesystem resource are forwarded unchanged into the destination filesystem and no dlt metadata tables are created.
TODO
- [ ] Implement test stubs
- [ ] set up ci to test filesystem source from all buckets (credentials "problem" is already solved in the copy tests)
- [ ] Update docs to explain how to use this feature
Deploy Preview for dlt-hub-docs canceled.
| Name | Link |
|---|---|
| Latest commit | 769314381ac0aa53da76e18796ce433f8f0b9cfa |
| Latest deploy log | https://app.netlify.com/projects/dlt-hub-docs/deploys/686fc8032e0fee0008231926 |
closing for later continuation