xtuner icon indicating copy to clipboard operation
xtuner copied to clipboard

Add a feature to merge the PTH format with the original LLM directly.

Open LiyanJin opened this issue 9 months ago • 0 comments

I need a LLM in the GGUF format. I have noticed that llama.cpp can convert files from the HF format to the GGUF format, and it can also convert files from the PTH format to the GGUF format. Therefore, I suggest that you add a feature to Xtuner that supports directly merging the PTH format with the original LLM.

LiyanJin avatar May 09 '24 13:05 LiyanJin