OpenAssistant_API_Pythia_12B icon indicating copy to clipboard operation
OpenAssistant_API_Pythia_12B copied to clipboard

Creating and Using an Open Assistant API locally (Pythia 12B GPT model)

trafficstars

OpenAssistant_API_Pythia_12B

Creating and Using an Open Assistant API locally (Pythia 12B GPT model)

  • OASST_tutorial.ipynb - Breaks down how everything works.
  • oasstapiv1.py - Host a local API for the Open Assistant Pythia 12B model.
  • chat-oasst-api.py - File to interact with the local API. You will need to modify SERVER_IP

Video tutorial:

Open Assistant as a Local ChatGPT API