VirtualClient icon indicating copy to clipboard operation
VirtualClient copied to clipboard

Superbenchmark executor: online inference config file and custom repo link

Open LiYueqian-James opened this issue 1 year ago • 2 comments

Added support for

  1. Feeding an online inference config file as a link, without the need to zip into packages and upload to storage account
  2. Feeding a different superbenchmark repo link other the default microsoft SB repo. Some users have added more benchmark to their own version of superbench and can use this method run them in VC.

LiYueqian-James avatar Aug 26 '24 20:08 LiYueqian-James

Could we do this instead: you are allowed to use extra dependency (for example git clone) in the profile, and you give it a package name. You then could reference the file you cloned by path.

yangpanMS avatar Aug 28 '24 05:08 yangpanMS

Could we do this instead: you are allowed to use extra dependency (for example git clone) in the profile, and you give it a package name. You then could reference the file you cloned by path.

so it's not just about inference config file. some people have created their own SB benchmarks (in their own repo) and want to run those. The official one do not have these benchmarks. That's why I added a parameter for repoLink

LiYueqian-James avatar Aug 28 '24 22:08 LiYueqian-James