cogdata
cogdata copied to clipboard
Published
20 hours ago •
Sleepychord
Sleepychord
A light-weight data management system for large-scale pretraining
Results
2
cogdata issues
Sort by
recently updated
recently updated
newest added
when I run `cogdata process --task_id test_task --nproc 2 --dataloader_num_workers 1 --ratio 1 test_ds` in the terminal, I got a different result from the guide.  And when I try...
[background] I want to use my own text-image datasets to generate binary format dataset for CogView training in 'https://github.com/THUDM/CogView'. It has been mentioned in that repo the author use this...
Metadata
15
Stars
0
Forks
Watchers
Owner
Metadata
A light-weight data management system for large-scale pretraining