wandb
[Integration Tests] Media upload/download Test
Media File Sync Integration test
This tests that all media types logged in history are stored as files and are able to be uploaded and downloaded with a matching SHA to ensure the integrity of the UP and down path of storing and retrieving media files to wandb server.
Scope of the integration tests
The set of tests being introduced here is to test the download/upload path of media files. In the original client we have work to make track down all the bugs reported by users and make sure they are covered in our rewrite and rework of file syncing. We want to preserve these with testing
In the past there has been issues with various media types logged partial data for timing issues. These tests aim to keep those down by adding a test that logs all the various types, uploads them to wandb/local and downloads them to check that the md5 matches from the time the file was targeted for upload to the time it returns from the server.
Soak Test Results
https://app.circleci.com/pipelines/github/wandb/client-ng?branch=tests%2Fall_media_types
15 in a row green. Aiming to get 20 shortly
Pull Request Test Coverage Report for Build 689e6a15-0096-4ce0-9c95-5fa9c348ba9b
- 0 of 0 changed or added relevant lines in 0 files are covered.
- 2 unchanged lines in 1 file lost coverage.
- Overall coverage decreased (-0.01%) to 60.545%
| Files with Coverage Reduction | New Missed Lines | % |
|---|---|---|
| wandb/compat/tempfile.py | 2 | 59.09% |
| <!-- | Total: | 2 |
| Totals | |
|---|---|
| Change from base Build 868c695d-f8a1-478e-9794-a34a6793f371: | -0.01% |
| Covered Lines: | 12545 |
| Relevant Lines: | 20720 |
💛 - Coveralls
Context Deadline exceeding. Need to sort this flake out first. Then will soak overnight again.
Found out how to soak a shit ton of jobs of circle.
About 30 here, running 70 more: https://app.circleci.com/pipelines/github/wandb/client-ng?branch=tests%2Fall_media_types