dbeam
dbeam copied to clipboard
Additional support of MariaDB
Additional support of Mariadb
The same question.
The same question.
I am working for it, but I am not sure if it will be accepted.
@matrixssy any progress ? thank you.
see https://github.com/NVIDIA/Megatron-LM/pull/667
Hi, Please refer to this script for MoE/Mixtral training.
Hi, Please refer to this script for MoE/Mixtral training.
Great! But I would like to know how to convert Hugging Face (HF) weights to Megatron (MG) format, and if it's possible to convert them back after training?
Marking as stale. No activity in 60 days.