maggma icon indicating copy to clipboard operation
maggma copied to clipboard

Adding Dask support to mrun

Open tsmathis opened this issue 2 years ago • 1 comments

Summary

Major changes:

added a Dask work broker for use with mrun

Todos

  • [ ] test run a builder on a distributed cluster
  • [ ] add documentation for the differences needed to write Dask-compatible builders

Checklist

  • [ ] Google format doc strings added.
  • [ ] Code linted with ruff. (For guidance in fixing rule violates, see rule list)
  • [ ] Type annotations included. Check with mypy.
  • [ ] Tests added for new features/fixes.
  • [ ] I have run the tests locally and they passed.

tsmathis avatar Feb 27 '24 01:02 tsmathis

Codecov Report

Attention: Patch coverage is 25.37313% with 50 lines in your changes are missing coverage. Please review.

Project coverage is 80.58%. Comparing base (53867d9) to head (245cf3e). Report is 9 commits behind head on main.

Files Patch % Lines
src/maggma/cli/dask_executor.py 0.00% 47 Missing :warning:
src/maggma/cli/__init__.py 85.00% 3 Missing :warning:
Additional details and impacted files
@@            Coverage Diff             @@
##             main     #927      +/-   ##
==========================================
- Coverage   81.56%   80.58%   -0.99%     
==========================================
  Files          46       47       +1     
  Lines        3938     4007      +69     
==========================================
+ Hits         3212     3229      +17     
- Misses        726      778      +52     

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

codecov[bot] avatar Feb 27 '24 23:02 codecov[bot]