ctransformers topic

Run inference on MPT-30B using CPU

abacaj

Python bindings for the Transformer models implemented in C/C++ using GGML library.

marella

Chat with your documents offline using AI.

marella

Your offline AI pair programmer for VSCode on Windows.

winstxnhdw

Run inference on replit-3B code instruct model using CPU

abacaj

Medical RAG QA App using Meditron 7B LLM, Qdrant Vector Database, and PubMedBERT Embedding Model.

AIAnytime

RAG (Retrieval-augmented generation) ChatBot that provides answers based on contextual information extracted from a collection of Markdown files.

umbertogriffo