bittensor
bittensor copied to clipboard
Improve nightly testing
- Create a docker image
Localnetbased on thesubtensor/mainbranch. This will allow running Bittensor master branch tests (which correspond to the release) with mainnet state. We can handle the case when Bittensor release is inconsistent with the main chain. Tests should runs:
- during Bittensor SDK release;
- each night.
- Nightly tests (cron based) should include 2 types of tests and run:
- Bittensor SDK
masterbased on thesubtensor/maindocker image; - Bittensor SDK
stagingbased on thesubtensor/devnet-readydocker image; - every
Saturdayfornon-fast-blocksfor staging; - every
Sundayfornon-fast-blocksfor master.
Actually, new logic should protect the next cases:
- Subtensor main net update - Bittensor SDK tests based master will be run;
- Subtensor devnet-ready - Bittensor SDK tests based on staging will be run;
- Bittensor SDK release - master tests will be run based on Localnet/
main netdocker image; - Bittensor SDK staging based PR - merging branch tests will be run based on Localnet/
devnet-readydocker image.
- Add a GH secret to publish the results of failed tests only to the channel https://discord.com/channels/1359000804123476081/1359003774915575909
- need to create new webhook (“Integrations” → “Webhooks” → “New Webhook”) and add Secret в GitHub