astro-sdk
astro-sdk copied to clipboard
Improve example of concept - datasets
Please describe the feature you'd like to see Currently, the example is a bit ambiguous doc - https://astro-sdk-python.readthedocs.io/en/stable/guides/concepts.html#datasets
Describe the solution you'd like We can be more explicit in explaining the datatypes passed around in different dags.
Additional context slack thread - https://astronomer.slack.com/archives/C02B8SPT93K/p1674223595865469
Acceptance Criteria
- [ ] We should be clear that how a dataset is created and passed along different dags sitting in different files.
- [ ] When will they be considered as the same dataset based on URI generated from the table/file object.