YangRUi
YangRUi
**To Reproduce** bash scripts/run_finetune_with_qlora_9_24_4.sh #!/bin/bash # Please run this script under ${project_id} in project directory of # Parses arguments #model_name_or_path=LLM-Research/Meta-Llama-3-70B-Instruct model_name_or_path=/data/hf_cache/hub/models--meta-llama--Meta-Llama-3-70B-Instruct/snapshots/5fcb2901844dde3111159f24205b71c25900ffbd #lora_model_path=/data/midreal/rio/lora/opening_0923 dataset_path=/data/midreal/rio/LMFlow-main/data/opening conversation_template=llama3 output_dir=/data/midreal/rio/LMFlow-main/output_models/qlora_finetuned_llama3_70b_opening_model_9_27 deepspeed_args="--master_port=13001 --include localhost:1" # Safety...
`{ "APIKEY": "sk-", "PORT":"30000", "HOST": "0.0.0.0", "LOG": true, "API_TIMEOUT_MS": 600000, "Providers": [ { "name": "openrouter", "api_base_url": "https://openrouter.ai/api/v1/chat/completions", "api_key": "sk", "models": [ "anthropic/claude-sonnet-4" ], "transformer": { "use": ["openrouter"] } } ],...