flytekit icon indicating copy to clipboard operation
flytekit copied to clipboard

mosaic data streaming integration

Open samhita-alla opened this issue 9 months ago • 6 comments

Tracking issue

Why are the changes needed?

What changes were proposed in this pull request?

this PR adds the mosaic data streamer to flytedirectory. i have some examples, but haven’t included them in this PR. merge this only if native integration is necessary. otherwise, supporting mosaic streaming through examples and tutorials should be sufficient.

How was this patch tested?

Setup process

Screenshots

Check all the applicable boxes

  • [ ] I updated the documentation accordingly.
  • [ ] All new and existing tests passed.
  • [ ] All commits are signed-off.

Related PRs

Docs link

samhita-alla avatar Mar 11 '25 12:03 samhita-alla

Code Review Agent Run Status

  • Limitations and other issues:  Failure - The AI Code Review Agent skipped reviewing this change because it is configured to exclude certain pull requests based on the source/target branch or the pull request status. You can change the settings here, or contact the agent instance creator at [email protected].

flyte-bot avatar Mar 11 '25 12:03 flyte-bot

Code Review Agent Run Status

  • Limitations and other issues:  Failure - The AI Code Review Agent skipped reviewing this change because it is configured to exclude certain pull requests based on the source/target branch or the pull request status. You can change the settings here, or contact the agent instance creator at [email protected].

flyte-bot avatar Mar 11 '25 15:03 flyte-bot

Codecov Report

Attention: Patch coverage is 32.52033% with 83 lines in your changes missing coverage. Please review.

Project coverage is 75.88%. Comparing base (7915afa) to head (9438bbc). Report is 45 commits behind head on master.

Files with missing lines Patch % Lines
flytekit/types/directory/types.py 31.96% 79 Missing and 4 partials :warning:
Additional details and impacted files
@@            Coverage Diff             @@
##           master    #3186      +/-   ##
==========================================
- Coverage   78.71%   75.88%   -2.83%     
==========================================
  Files         293      277      -16     
  Lines       25790    25004     -786     
  Branches     2897     2947      +50     
==========================================
- Hits        20300    18974    -1326     
- Misses       4681     5213     +532     
- Partials      809      817       +8     

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

:rocket: New features to boost your workflow:
  • :snowflake: Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

codecov[bot] avatar Mar 12 '25 11:03 codecov[bot]

Code Review Agent Run Status

  • Limitations and other issues:  Failure - The AI Code Review Agent skipped reviewing this change because it is configured to exclude certain pull requests based on the source/target branch or the pull request status. You can change the settings here, or contact the agent instance creator at [email protected].

flyte-bot avatar Mar 12 '25 11:03 flyte-bot

Code Review Agent Run Status

  • Limitations and other issues:  Failure - The AI Code Review Agent skipped reviewing this change because it is configured to exclude certain pull requests based on the source/target branch or the pull request status. You can change the settings here, or contact the agent instance creator at [email protected].

flyte-bot avatar Mar 13 '25 15:03 flyte-bot

Code Review Agent Run Status

  • Limitations and other issues:  Failure - Bito Automatic Review Skipped - Draft PR

    Bito didn't auto-review because this pull request is in draft status.
    To trigger review, mark the PR as ready or type /review in the comment and save.
    You can change draft PR review settings here, or contact the agent instance creator at [email protected].

flyte-bot avatar Apr 17 '25 17:04 flyte-bot