Visual-Chinese-LLaMA-Alpaca issues

训练数据

3

请问训练数据来自哪里呢？中文captioning的数据质量相对较差啊

训练/微调代码

你好，我想在模型上进行一些sft训练，想请问下是否可以开源预训练和微调的代码呢？

1.FileNotFoundError: [Errno 2] No such file or directory: './models/visualcla_merged-7b/pytorch_model.bin' 对于合并权重的情况需要cp visualcla/pytorch_model.bin models/visualcla_merged-7b/ 不知道这样对不对 2.OSError: Can't load the configuration of './models/visualcla_merged-7b/vision_encoder'. If you were trying to load it from 'https://huggingface.co/models',...

yisampi

RuntimeError: probability tensor contains either `inf`, `nan` or element < 0

6

$ python scripts/inference/inference.py --visualcla_model visualcla --image_file pics/examples/food.jpg --load_in_8bit [INFO|tokenization_utils_base.py:1837] 2023-07-24 16:05:27,669 >> loading file tokenizer.model [INFO|tokenization_utils_base.py:1837] 2023-07-24 16:05:27,669 >> loading file added_tokens.json [INFO|tokenization_utils_base.py:1837] 2023-07-24 16:05:27,669 >> loading file special_tokens_map.json [INFO|tokenization_utils_base.py:1837]...

yisampi