olla
olla copied to clipboard
Cost tracking
It would be cool if there is a way that you can describe the costs of running a model, namely input/output in token/$. I'd imagine this becoming even more useful with an eventual olla admin panel.