aikit icon indicating copy to clipboard operation
aikit copied to clipboard

[REQ] auto detect runtime for an inference container

Open sozercan opened this issue 1 year ago • 1 comments

What kind of request is this?

Improvement of existing experience

What is your request or suggestion?

https://github.com/mudler/LocalAI/issues/1888

Are you willing to submit PRs to contribute to this feature request?

  • [ ] Yes, I am willing to implement it.

sozercan avatar Mar 25 '24 02:03 sozercan

docker already has this functionality built-in with platforms (such as linux/amd64/v2, linux/amd64/v3, etc) https://en.wikipedia.org/wiki/X86-64#Microarchitecture_levels

This doesn't exist for gpus

sozercan avatar Mar 26 '24 19:03 sozercan

fixed with #225

sozercan avatar May 25 '24 01:05 sozercan