LiamMing5

try to replace the config.json file in your /path/to/model with the vllm version detail info: https://huggingface.co/SparseLLM/prosparse-llama-2-13b _Here are the steps to adapting the original [vLLM](https://github.com/vllm-project/vllm) to ProSparse models. Replace the...