rudolfix
rudolfix
**Which source is this for** adds git filesystem support to `filesystem` source **Describe the data you'd like, be specific, link the docs** We want to support git in `filesystem` source...
**Which source is this for** example: Notion **Describe the data you'd like, be specific, link the docs** As the Notion source deals with databases and tables in similar way to...
**Which source is this for** asana_dlt, facebook_ads, **Describe the data you'd like, be specific, link the docs** 1. we enable external schedulers for all Incrementals that work with date ranges....
**Background** Since we started to declare the range of compatible dlt versions for each verified sources we should verify if they work on those versions. **Tasks** 1. * [ ]...
Write a test helper asserting a happy path for each pipeline 1. pipeline is run against all destinations with a full_refresh 2. pipeline loads correctly 3. for each table in...
### Description master merge for 0.5.3 release
**Background** See how sql-mesh is doing that. amazing: https://sqlmesh.readthedocs.io/en/stable/reference/notebook/ if we do that we allow our users to easily add verified sources in notebooks and inspect working pipelines. we may...
**Background** With working `fsspec` we may recognize and automatically load data from various uris. We can combine this with a few additional types like pandas frame. - accept strings as...
We have click dependency but we do not use it. We use a few functions to display color messages and process yes/no choices. investigate if that can be easily removed
**Background** We started to store pipeline state and schemas in `filesystem` destination to be able to restore them. In case of state table each load may produce a new file....