BlueRum

[bf16] Add dtype-bf16 supporting with naive_amp

2

Add dtype-bf16 supporting with naive_amp.

amp and Zero bf16 support

2

Support bf16 data type in amp and zero.

Fix amp test bf16

1

fix test_naive_bf16.py

[chatgpt] fix rm eval

1

## 📌 Checklist before creating the PR - [ ] I have created an issue for this PR for traceability - [ ] The title follows the standard format: `[doc/gemini/tensor/...]:...

## 📌 Checklist before creating the PR - [ ] I have created an issue for this PR for traceability - [ ] The title follows the standard format: `[doc/gemini/tensor/...]:...

## 📌 Checklist before creating the PR - [ ] I have created an issue for this PR for traceability - [ ] The title follows the standard format: `[doc/gemini/tensor/...]:...

## 📌 Checklist before creating the PR - [ ] I have created an issue for this PR for traceability - [ ] The title follows the standard format: `[doc/gemini/tensor/...]:...

[chatgpt] change critic input as state

1

### Discussed in https://github.com/hpcaitech/ColossalAI/discussions/3031 Originally posted by **wenjunyang** March 7, 2023 i have a doubt about class Critic in `applications/ChatGPT/chatgpt/nn/critic.py`. in common A2C RL algorithm，Critic is the function of current...

[chatgpt]update ci

1

## 📌 Checklist before creating the PR - [ ] I have created an issue for this PR for traceability - [ ] The title follows the standard format: `[doc/gemini/tensor/...]:...

[chatgpt]Reward Model Training Process update

1

## 📌 Checklist before creating the PR - [ ] I have created an issue for this PR for traceability - [ ] The title follows the standard format: `[doc/gemini/tensor/...]:...