atlantic8

fine-tune HKUNLP/instructor-embedding

7

can we fine-tune using train.py based on the released model hkunlp/instructor-xl? If yes, could you please show me the shell script for training? thanks

Train in multi-node multi-card environment

2

can I use tevatron to train models in multi-node multi-card environment ? if yes, could you please give script examples to demonstrate how to start the job, thank you

help to do SFT usning multi-machine, for example 8 nodes (1 A100 for 1 node)

1

I modified deepspeed_sero3.yaml, set num_machines to 8 and num_processes to 8, and I got the following error, what else should I do to run SFT on 8 nodes platform. Thanks...