TextGenWebUI-Colab icon indicating copy to clipboard operation
TextGenWebUI-Colab copied to clipboard

Text Generation WebUI via Vicuna or Alpaca in google colaboratory

TextGenWebUI-Colab

Text Generation WebUI via Vicuna or Alpaca in Google Colaboratory.

⚠️ Ensure that Google Drive is available for storage. ⚠️

Open In Colab

Overview

This project provides a web-based user interface for text generation using either the Alpaca or Vicuna models. It is intended to be run in Google Colaboratory, and requires access to Google Drive for storage.

The web UI is based on the text-generation-webui repository, which provides a simple interface for generating text using a pre-trained language model.

Model

This project includes two pre-trained language models:

  • Alpaca 13B (4-bit, 128G) - https://huggingface.co/anon8231489123/gpt4-x-alpaca-13b-native-4bit-128g
  • Vicuna 13B (4-bit, 128G) - https://huggingface.co/anon8231489123/vicuna-13b-GPTQ-4bit-128g