dlt
dlt copied to clipboard
expose dlt commands to notebooks as magics + improve colab experience
Background See how sql-mesh is doing that. amazing: https://sqlmesh.readthedocs.io/en/stable/reference/notebook/ if we do that we allow our users to easily add verified sources in notebooks and inspect working pipelines. we may also think about some notebook-specific magic ie. showing current config and secrets
Tasks
-
- [ ] add magics for
init
,pipeline
and other commands
- [ ] add magics for
-
- [ ] there's a known limitation on Colab - their file editor cannot show files starting with
.
the result is that users do not see the.dlt
folder with secrets and configs. we should solve this somehow. ie. bydlt init
that detects running on colab (there's a helper) and then creates a link ie._dlt
that is visible
- [ ] there's a known limitation on Colab - their file editor cannot show files starting with
-
- [ ] add a demo colab notebook and documentation to
reference
section of the docs
- [ ] add a demo colab notebook and documentation to