llama-lora-fine-tuning icon indicating copy to clipboard operation
llama-lora-fine-tuning copied to clipboard

Published 20 hours ago • verified publisher icon git-cloner

ModuleNotFoundError: No module named 'utils.prompter'

Open cyrilakafia opened this issue 1 year ago • 1 comments

my commonda to test the finetuned model

! CUDA_VISIBLE_DEVICES=0 python generate.py --base_model '/content/drive/MyDrive/Colab Notebooks/llama_finetuning/llama-lora-fine-tuning/llama-7b-hf' --lora_weights '/content/drive/MyDrive/Colab Notebooks/llama_finetuning/output'

error

CUDA SETUP: Loading binary /usr/local/lib/python3.10/dist-packages/bitsandbytes/libbitsandbytes_cuda118.so... [2023-08-18 02:27:44,650] [INFO] [real_accelerator.py:133:get_accelerator] Setting ds_accelerator to cuda (auto detect) 2023-08-18 02:27:50.421384: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Could not find TensorRT Traceback (most recent call last): File "/content/drive/.shortcut-targets-by-id/1-8pwxu1XoRTFqpdzvU1bdVqJa2Nr6xkj/llama-lora-fine-tuning/generate.py", line 10, in from utils.prompter import Prompter ModuleNotFoundError: No module named 'utils.prompter'

cyrilakafia avatar Aug 18 '23 02:08 cyrilakafia