can-ai-code icon indicating copy to clipboard operation
can-ai-code copied to clipboard

OpenAPI update for text-generation-webui

Open kisimoff opened this issue 4 months ago • 2 comments

Update: OpenAPI Integration for text-generation-webui

This MR updates the evaluation script to use the OpenAI API with the text-generation-webui.

Workflow

  • No changes in the preparation steps.

  • To run the script interview-oobabooga.py, simply add the host flag and host:port used in ooba. Example:

    python interview-oobabooga.py --host 0.0.0.0:1234
    

    + the rest of the flags

kisimoff avatar Apr 15 '24 18:04 kisimoff

@kisimoff Thanks for the PR! Could you rebase it and back out the README.md change? Then it's good to merge.

the-crypt-keeper avatar May 06 '24 23:05 the-crypt-keeper