Ian Webster

If you do not want to use epicbox, you could replace it with a bespoke Docker setup in the custom provider here: https://www.promptfoo.dev/docs/guides/sandboxed-code-evals/#set-up-the-python-assertion-script Sandboxing is somewhat out of the scope...

What do you think is the best behavior here? Global setting to show/hide columns with the same name between different evals?

Hi @bharathiprodapt, check out https://www.promptfoo.dev/docs/guides/text-to-sql-evaluation/. If you actually want to fetch live SQL results on-the-fly, you may have to write a custom provider. For example: https://www.promptfoo.dev/docs/providers/python/

+1 to removing these. I don't know that anyone is still using these models!

That sounds reasonable to me :) On Thu, Feb 20, 2025 at 12:05 PM G. Hussain Chinoy ***@***.***> wrote: > @typpo I was thinking of possibly moving them > below...

I _think_ this is caused by the app.promptfoo.dev instance running an older version that uses localStorage instead of indexDb. We're in the process of improving the cloud deployment so hopefully...