jussker

This is a great solution and it's useful. https://gist.github.com/CGamesPlay/dd4f108f27e2eec145eedf5c717318f5 Usage: ```python base_usage = ... # message tokens + image tokens tools = [...] # A list of tools ... encoder...

> ran it on 8x a100 80g with the code in this repo(no modification, i just added a loop to get input from terminal), using 524GB of vram during single...

file `config.json` ``` { ... "models": [ { "title": ..., "model": ..., "provider": ..., "apiBase": ..., "apiKey": ..., "systemMessage": "You are an expert software developer. You give helpful and concise...