Random

[FEATURE]: Is there a solution about imae duplication?

1

### Is there an existing issue for this? - [X] I have searched the existing issues ### Is your feature request related to a problem? Please describe. 我想对亿级的图片数据进行去重 ### Describe...

Sub-workers exits without messages

7

## 🐛 Bug I use the script as follow: CUDA_VISIBLE_DEVICES="0, 1, 2, 3" metaseq-train --task streaming_language_modeling \ data/pile-test/ \ --num-workers 4 \ --reset-dataloader \ --vocab-filename ./vocab/gpt2-vocab.json \ --merges-filename ./vocab/gpt2-merges.txt \...

How to finetune from a consolidated model ?

1

There are the ways to reshard the trained model to inference model, but how to retrain the model from the consolidated model ? (like llama)