ColossalAI icon indicating copy to clipboard operation
ColossalAI copied to clipboard

Published 20 hours ago • verified publisher icon hpcaitech

[FEATURE]: Data Toolkit

Open cliangyu opened this issue 1 year ago • 4 comments

Describe the feature

I appreciate your great work of releasing llama 2 model. When will Data Processing Toolkit be released?

cliangyu avatar Oct 23 '23 10:10 cliangyu

Hi,

Yes, we are planning to open-source the data processing toolkit for the whole community.

TongLi3701 avatar Oct 26 '23 02:10 TongLi3701

Any update or ETA? Thank you!

cliangyu avatar Nov 22 '23 06:11 cliangyu

This part is now under internal review. Will be released soon.

TongLi3701 avatar Nov 22 '23 07:11 TongLi3701

This part is now under internal review. Will be released soon.

Hi,

I was wondering if there are any upcoming data-processing toolkit that will be open-sourced soon? I am eagerly anticipating such releases.

LiuChen19960902 avatar Jan 31 '24 08:01 LiuChen19960902