Anchen

Host the GPTQ model using AutoGPTQ as an API that is compatible with text generation UI API.

mzbac

Node client to making API calls to ChatGPT.

mzbac

mzbac

Provide a way to use the GPT-QLLama model as an API

mzbac

Scripts for fine-tuning Llama2 via SFT and DPO.

mzbac

For inferring and serving local LLMs using the MLX framework

mzbac

mzbac