ColossalAI icon indicating copy to clipboard operation
ColossalAI copied to clipboard

Published 20 hours ago • verified publisher icon hpcaitech

[DOC]: Hope to get your answer!

Open X-jun-0130 opened this issue 2 years ago • 3 comments

📚 The doc issue

two options:

  1. 8*24G A40900
  2. 8*48G A6000 .

I have LLM 11B, RewardModel 1B.
which option can run PPO model?

X-jun-0130 avatar Feb 22 '23 02:02 X-jun-0130

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

Title: [DOC]: Hope to get your answer!

Issues-translate-bot avatar Feb 22 '23 02:02 Issues-translate-bot

8*24G 4090 sorry!

X-jun-0130 avatar Feb 22 '23 02:02 X-jun-0130

Larger memory is more possible. You can try memory optimizations like zero, gemini, offload, etc. if encounter OOM.

binmakeswell avatar Feb 28 '23 07:02 binmakeswell

We have updated a lot. This issue was closed due to inactivity. Thanks.

binmakeswell avatar Apr 20 '23 07:04 binmakeswell