JQian

Hello, I recently finetuned the Llama2 model with one node and multiple GPUS using the following command, aiming to adapt it to my own dataset: ``` torchrun --nnodes 1 --nproc_per_node...

## ❓ General Questions Hi there, I just want to ask that for the pruned model, how can we deploy it using MLC-LLM? Since the qkv dimensions in each layer...