Tiancheng Si
Results
1
issues of
Tiancheng Si
**Describe the bug** bash vllm_inference.sh --model_name_or_path ./Llama-2-7b-hf --dataset_path data/alpaca/test_conversation --output_dir data/inference_results [2025-04-03 14:16:08,168] [INFO] [real_accelerator.py:239:get_accelerator] Setting ds_accelerator to cuda (auto detect) Consider install flash_attn for better performance. Checking dataset keys:...
pending