James Braza

Oh @linjer thanks for following up. Yeah your ideal was basically overriding `rye lint` such that `rye lint` runs Ruff, `mypy`, and possibly other tools. I like your request, it...

Okay thanks for answering, I follow. I guess consider adding to the README that macOS without CUDA is currently unsupported, otherwise feel free to close this out

@MrOiseau look in that stack trace near the top: ``` 2023-09-20 00:55:59 ERROR:Could not find repositories/exllama. Please ensure that exllama (https://github.com/turboderp/exllama) is cloned inside repositories/ and is up to date....

Oh you're right there per the `Variables`. However, but you can't turn off the `Description` field See lower left corner of the above screenshot Do you think you can make...

@typpo thanks for #1095! After pulling in v0.69.2 to try this out, I don't see where in the UI to toggle the description

I am not seeing that option in my run today: https://app.promptfoo.dev/eval/f:96a89d44-4ada-4577-9cd2-7bf8bc7f9433/ Maybe I failed to properly pull in the latest `promptfoo`

I confirmed with 0.69.2 locally that what you're seeing (checkbox for description), I am not seeing that same checkbox. Note the web UI I am using was made by `--share`

Yeah actually I did also observe that the `\n` was involved with the warning showing up or not showing up. Though I chose to ignore this seeming edge case in...

I now understand that I have three assertions: - Two binary ones: can be score 0 or 1 - One custom assertion: can be score 0, 0.1, 1 I realized...

Realizing this may be enabled by https://github.com/promptfoo/promptfoo/issues/150