ayttop

It doesn't work and doesn't translate a sentence or a text file.

!git clone https://github.com/intel/intel-extension-for-transformers.git !python /content/intel-extension-for-transformers/examples/huggingface/pytorch/translation/quantization/run_translation.py \ --model_name_or_path Helsinki-NLP/opus-mt-en-ro \ --do_train --do_eval \ --source_lang en \ --target_lang ro \ --dataset_name wmt/wmt16 \ --dataset_config_name ro-en \ --output_dir /tmp/tst-translation \ --per_device_train_batch_size 4 \...

???????

?????????

how to run flux on ipex-llm??????

pip install lama cpp python==0.2.5

https://github.com/intel-analytics/ipex-llm/blob/main/docs/mddocs/Quickstart/llama_cpp_quickstart.md

Same problem

https://github.com/intel-analytics/ipex-llm/blob/main/docs/mddocs/Quickstart/llama_cpp_quickstart.md

Failed to post request http://Localhost:11434