llamafile icon indicating copy to clipboard operation
llamafile copied to clipboard

Feature Request: Add support for Raspberry Pi Ai Kit

Open beingminimal opened this issue 6 months ago • 5 comments

Prerequisites

  • [X] I am running the latest code. Mention the version if possible as well.
  • [X] I carefully followed the README.md.
  • [X] I searched using keywords relevant to my issue to make sure that I am creating a new issue that is not already open (or closed).
  • [X] I reviewed the Discussions, and have a new and useful enhancement to share.

Feature Description

Add support for raspberry pi ai kit to run llamafile.

Motivation

It will be much faster to run LLM on such a small and cheaper device.

Possible Implementation

Not aware

beingminimal avatar Aug 20 '24 17:08 beingminimal