astro-sdk icon indicating copy to clipboard operation
astro-sdk copied to clipboard

Split `load_file` example DAG

Open phanikumv opened this issue 1 year ago • 0 comments

Please describe the feature you'd like to see I really wish we can split our load_file example DAG into logical groups (or) just split it into manageable parts. Currently its too big and takes up most of the time in our CICD

Describe the solution you'd like A clear and concise description of what you want to happen, if possible with code examples.

Are there any alternatives to this feature? Is there another way we could solve this problem or enable this use-case?

Additional context Add any other context about the feature request here.

Acceptance Criteria

  • [ ] All checks and tests in the CI should pass
  • [ ] Unit tests (90% code coverage or more, once available)
  • [ ] Integration tests (if the feature relates to a new database or external service)
  • [ ] Example DAG
  • [ ] Docstrings in reStructuredText for each of methods, classes, functions and module-level attributes (including Example DAG on how it should be used)
  • [ ] Exception handling in case of errors
  • [ ] Logging (are we exposing useful information to the user? e.g. source and destination)
  • [ ] Improve the documentation (README, Sphinx, and any other relevant)
  • [ ] How to use Guide for the feature (example)

phanikumv avatar Feb 27 '23 09:02 phanikumv