YukinoshitaKaren

请问模型启动一半卡住，是什么问题？

6

main: seed = 1681116321 llama_model_load: loading model from 'zh-models/7B/ggml-model-f16.bin' - please wait ... llama_model_load: n_vocab = 49954 llama_model_load: n_ctx = 2048 llama_model_load: n_embd = 4096 llama_model_load: n_mult = 256 llama_model_load:...

Step2: memory allocation of 2097152 bytes failed

3

when I run step2 using 'bash training_scripts/single_node/run_350m.sh' meet error ```[2023-04-16 21:36:09,031] [INFO] [launch.py:229:main] WORLD INFO DICT: {'localhost': [0, 1, 2, 3, 4, 5, 6, 7]} [2023-04-16 21:36:09,031] [INFO] [launch.py:235:main] nnodes=1,...