Megatron-DeepSpeed icon indicating copy to clipboard operation
Megatron-DeepSpeed copied to clipboard
verified publisher icon bigscience-workshop

Distill BLOOM - tentative 2

Open younesbelkada opened this issue 3 years ago • 0 comments

Tentative of applying teacher student using Megatron-DeepSpeed

WIP draft PR - not supposed to merge

cc @thomasw21

younesbelkada avatar Oct 11 '22 09:10 younesbelkada