Huatuo-Llama-Med-Chinese

Huatuo-Llama-Med-Chinese copied to clipboard

yfangZhang


yfangZhang

为何使用Bloom model测试结果有问题？

1


wuyuanmm

但节点多GPU训练

1

请问有实现单节点多GPU并行训练的代码吗，谢谢🙏

zjhJOJO

生成答案重复

2

非常感谢您的贡献，我基于活字1.0进行了lora模型的复现工作，下面是我的复现结果：   我想请教您关于模型回答一直重复的问题（在temperature=1.0的情况下），我在进行其他模型训练的时候也经常遇到类似的问题，我想知道这个问题产生的具体原因是什么？是因为训练方式的原因，还是因为推理时参数设置的原因呢？万分感谢！！！

loki1017

UnicodeDecodeError: 'gbk' codec can't decode byte 0xaf in position 93: illegal multibyte sequence

2

Traceback (most recent call last): File "E:\wbjdata\QA\Huatuo-Llama-Med-Chinese-main\Huatuo-Llama-Med-Chinese-main\1.py", line 124, in fire.Fire(main) File "E:\anaconda3\envs\LLAMA10\lib\site-packages\fire\core.py", line 141, in Fire component_trace = _Fire(component, args, parsed_flag_args, context, name) File "E:\anaconda3\envs\LLAMA10\lib\site-packages\fire\core.py", line 475, in _Fire...

cookie925

RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:1 and cuda:0! (when checking argument for argument index in method wrapper_CUDA__index_select)

2

我使用llama 65b 在多GPU A100 infer.py推理的时候报了错误， 在finetune.py没有问题

daiyizheng

大家好！ 我今天试着跑了下这个 Huatuo-Llama-Med-Chinese （整个过程见下文说明），然后遇到了这个错误： ``` $ bash scripts/infer.sh /usr/lib/python3/dist-packages/requests/__init__.py:87: RequestsDependencyWarning: urllib3 (2.0.4) or chardet (4.0.0) doesn't match a supported version! warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported "...

Pingmin

报错BrokenPipeError: [Errno 32] Broken pipe，完整报错如下，请问这是哪里的问题

1

===================================BUG REPORT=================================== Welcome to bitsandbytes. For bug reports, please submit your error trace to: https://github.com/TimDettmers/bitsandbytes/issues ================================================================================ /opt/conda/envs/huatuo/lib/python3.9/site-packages/bitsandbytes/cuda_setup/main.py:136: UserWarning: /opt/conda/envs/huatuo did not contain libcudart.so as expected! Searching further paths... warn(msg) /opt/conda/envs/huatuo/lib/python3.9/site-packages/bitsandbytes/cuda_setup/main.py:136:...

pandazzh2020

NotImplementedError: Cannot copy out of meta tensor; no data!

1

│ │ │ 403 │ │ │ │ device_map = infer_auto_device_map( │ │ 404 │ │ │ │ │ self, max_memory=max_memory, no_split_module_classes=no_split_module │ │ 405 │ │ │ │ )...

sjtuzhaoxh