Asankhaya Sharma

Hi, Since this is a recent repository, if someone wants to generate code that uses this library in either chatGPT or any other coding assistant it doesn't work. Would it...

Scrub the api keys and other sensitive outputs when running in debug mode

2

when `--debug` mode is enabled, make sure not to print api keys to the logs

- Allow users to specify classes to test - Automatically generate unit tests for methods in those classes - Decide on what framework we will use for generating tests

Fails to check ftp URLs with username and password

7

I was trying to test this library with GramTest, a grammar based test case generation tool (https://github.com/codelion/gramtest). I found that it fails to to check ftp URLs. `isUrl('ftp://username:password@hostname') //returns false`

I tried to fuzz the library again using GramTest, a grammar based test case generation tool (https://github.com/codelion/gramtest). I found that it fails to to check mailto URLs. `isUrl('mailto:[email protected]') // false`

Add a lighting template for running optillm

1

https://lightning.ai/studios

Create a gradio based GUI to compare different approaches

1

Initially brought up in #8 having a GUI would make it easier to visualize and compare different approaches.

optillm supports logits or logprobs in the API

1

Add documentation to show how to use optillm with local inference server for getting logits. This is a commonly requested feature in ollama https://github.com/ollama/ollama/issues/2415 that is already supported in optillm...