ColossalAI
ColossalAI copied to clipboard
hpcaitech
Making large AI models cheaper, faster and more accessible
## 📌 Checklist before creating the PR - [x] I have created an issue for this PR for traceability - [x] The title follows the standard format: `[doc/gemini/tensor/...]: A concise...
### Overview There are three version implementations of tracer. They solve different problems and fail in different scenarios. To make it clear, we need to integrate them into one framework....
### 🐛 Describe the bug When trying to finetune the Teyvat example on 2 GPU, the training stuck right after the first epoch starts to run. ERRORS is like: `Epoch...
## 📌 Checklist before creating the PR - [ ] I have created an issue for this PR for traceability - [x] The title follows the standard format: `[doc/gemini/tensor/...]: A...
## 📌 Checklist before creating the PR - [x] The title follows the standard format: `[doc/gemini/tensor/...]: A concise description` ## 📝 What does this PR do? This PR aims to...
[BUG]This happened after I ran Colossal after building the environment according to the instructions
### 🐛 Describe the bug Traceback (most recent call last): File "/root/anaconda3/bin/colossalai", line 5, in from colossalai.cli import cli File "/root/anaconda3/lib/python3.9/site-packages/colossalai/__init__.py", line 1, in from .initialize import ( File "/root/anaconda3/lib/python3.9/site-packages/colossalai/initialize.py",...
### Describe the feature ChatGLM-6B is a new Chinese chatGPT alternative. The weights are open sourced and we need to support tuning the model under Chat application. I've already implemented...
### 🐛 Describe the bug ### command ```shell git clone https://github.com/hpcaitech/ColossalAI.git cd ColossalAI # install colossalai pip install . # install chat cd applications/Chat pip install . git clone https://github.com/hpcaitech/transformers...
## 📌 Checklist before creating the PR - [x] I have created an issue for this PR for traceability - [x] The title follows the standard format: `[doc/gemini/tensor/...]: A concise...
### 🐛 Describe the bug Firstly thanks for releasing codes fo boosting and memory saving. When I try to use the code of training dreambooth from example, something weird happened....
