model-inference topic

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

bentoml

Run any open-source LLMs, such as Llama 3.1, Gemma, as OpenAI compatible API endpoint in the cloud.

bentoml

Resources of our survey paper "A Systematic Review of AI Deployment on Resource-Constrained Edge Devices: Challenges, Techniques, and Applications"

wangxb96

CLIP as a service - Embed image and sentences, object recognition, visual reasoning, image classification and reverse image search

bentoml

Генерация описаний к изображениям с помощью различных архитектур нейронных сетей

Koldim2001

Streamlining the process for seamless execution of PyCoral in running TensorFlow Lite models on an Edge TPU USB.

DAVIDNYARKO123

EmbeddedLLM: API server for Embedded Device Deployment. Currently support CUDA/OpenVINO/IpexLLM/DirectML/CPU

EmbeddedLLM