dblab0

Results 4 comments of dblab0

用vllm推理,服务里默认有10个worker

> ![屏幕截图 2024-10-07 215451](https://private-user-images.githubusercontent.com/94674846/374197785-307d5617-7392-4b39-a636-f6def0b85472.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzIyNDQ2MzQsIm5iZiI6MTczMjI0NDMzNCwicGF0aCI6Ii85NDY3NDg0Ni8zNzQxOTc3ODUtMzA3ZDU2MTctNzM5Mi00YjM5LWE2MzYtZjZkZWYwYjg1NDcyLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDExMjIlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQxMTIyVDAyNTg1NFomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTNiYjFkY2U0MTZhYWFiNjZjMTE2ZDU2MTdiNDMyZTNlZDI2MGRkOTVlMzk3NjI2MDlmYTYzMjJlMmQ1YjhkMmQmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.uD4PIJWTSTVW0-p8LQsL80mWCneu9PfIiV7F3amHoe8) 单卡4060ti 16g为啥比你的2080Ti差那么多,我这个时间是正常的吗 我的4060Ti 16G 64batch,一个epoch678min,之前试32batch也是这样。应该就是算力差了比较多