Perplexica icon indicating copy to clipboard operation
Perplexica copied to clipboard

Published 20 hours ago • verified publisher icon ItzCrazyKns

Llamafile support

Open Nocturna22 opened this issue 4 months ago • 0 comments

Is your feature request related to a problem? Please describe. Many do not have the best hardware. Llamafile can help here, because it promises an improvement in speed of 30-500% t/s.

Describe the solution you'd like I would like to start the Llamafile. It offers an API. In the Perplexica settings I want to be able to choose to use Llamafile and specify localhost:8080.

Nocturna22 avatar Oct 04 '24 07:10 Nocturna22