Feature Request: Support AWS inferentia inf2 instances

[mavwolverine]

Prerequisites

• [X] I am running the latest code. Mention the version if possible as well.
• [X] I carefully followed the README.md.
• [X] I searched using keywords relevant to my issue to make sure that I am creating a new issue that is not already open (or closed).
• [X] I reviewed the Discussions, and have a new and useful enhancement to share.

Feature Description

AWS inf2 instances are supposed to provide better performance at cheaper rates. It would be great to support these instances.

Motivation

#2109 https://github.com/ollama/ollama/issues/6143

Possible Implementation

No response