LLaMA3-Quantization
LLaMA3-Quantization copied to clipboard
Evaluation of EXL2?
This test shows the exl2 quant is the best:https://huggingface.co/blog/wolfram/llm-comparison-test-llama-3
Will you to test it?