FlagAI icon indicating copy to clipboard operation
FlagAI copied to clipboard

Published 20 hours ago • verified publisher icon FlagAI-Open

[Question]: chatAquila-7B怎么设置单机多卡部署

Open UTimeStrange opened this issue 2 years ago • 2 comments

Description

如题

Alternatives

No response

UTimeStrange avatar Jun 15 '23 09:06 UTimeStrange

得先把模型切片然后加载，我们近期会把这个功能加上去

BAAI-OpenPlatform avatar Jun 15 '23 10:06 BAAI-OpenPlatform

请问这个啥时候能支持

camel007 avatar Jun 19 '23 09:06 camel007

https://github.com/FlagAI-Open/FlagAI/tree/master/examples/Aquila/Aquila-server/Aquila-multigpu-infer

ftgreat avatar Jul 17 '23 02:07 ftgreat