bittensor icon indicating copy to clipboard operation
bittensor copied to clipboard

Model Parallelism

Open robertalanm opened this issue 3 years ago • 2 comments

Utilizing the Accelerate package from HuggingFace allows us to run larger models than 6.7B.

robertalanm avatar Jul 14 '22 16:07 robertalanm

Pull Request Test Coverage Report for Build 229addf5-3ea8-4a95-81b7-ae212f19f0a6

  • 0 of 0 changed or added relevant lines in 0 files are covered.
  • No unchanged relevant lines lost coverage.
  • Overall coverage increased (+15.8%) to 81.862%

Totals Coverage Status
Change from base Build e1f35022-707d-4103-925b-b2ed8c0a1236: 15.8%
Covered Lines: 4247
Relevant Lines: 5188

💛 - Coveralls

coveralls avatar Jul 14 '22 16:07 coveralls

should this be based off of Synapse and have the changes in core_server instead?

joeylegere avatar Jul 14 '22 17:07 joeylegere