GaLore icon indicating copy to clipboard operation
GaLore copied to clipboard

Dataset loading issue, integration with Colossal-AI

Open Edenzzzz opened this issue 10 months ago • 3 comments

Hi, Thanks for the good work. I'm trying to intergrate this into Colossal-AI(https://github.com/hpcaitech/ColossalAI), compatible with Tensor Parallel and ZeRO. However, I had trouble loading the dataset; seems they updated the dataset to remove the json schema. Could you share your dataset version and how you're able to load it? Thanks! image

Edenzzzz avatar Mar 29 '24 09:03 Edenzzzz