jussker

This is a great solution and it's useful. https://gist.github.com/CGamesPlay/dd4f108f27e2eec145eedf5c717318f5 Usage: ```python base_usage = ... # message tokens + image tokens tools = [...] # A list of tools ... encoder...

> ran it on 8x a100 80g with the code in this repo(no modification, i just added a loop to get input from terminal), using 524GB of vram during single...