rraulison

AMD quantize

4

trying to quantize and no model is generated my hardware is amd ```python quantize.py --checkpoint_path checkpoints/$MODEL_REPO/model.pth --mode int8 Loading model ... Quantizing model weights for int8 weight-only symmetric per-channel quantization...

hello! python app.py says: ``` python app.py /home/pai/text-generation-webui/Zephyr-7B-beta-RAG-Demo/.conda/lib/python3.10/site-packages/langchain/__init__.py:34: UserWarning: Importing PromptTemplate from langchain root module is no longer supported. Please use langchain.prompts.PromptTemplate instead. warnings.warn( /home/pai/text-generation-webui/Zephyr-7B-beta-RAG-Demo/.conda/lib/python3.10/site-packages/langchain/__init__.py:34: UserWarning: Importing LLMChain from langchain...