durant1999

> 家人们，我成功了！启动的时候设置下两个参数，参考如下： `llm = LLM(model=model_path, tokenizer=model_path, max_num_batched_tokens=32768, max_model_len=32768, tensor_parallel_size=8, trust_remote_code=True, load_format = "auto", enforce_eager=True, \ ray_workers_use_nsight=True, distributed_executor_backend="ray" )` > > 关键参数： `ray_workers_use_nsight=True, distributed_executor_backend="ray"` > > 使用的 nsys 版本如下： https://developer.nvidia.com/downloads/assets/tools/secure/nsight-systems/2024_4/NsightSystems-linux-cli-public-2024.4.1.61-3431596.deb >...

the same question...