James Braza
James Braza
Okay @typpo just to follow up on this, use of `vars` is now possible in assertions via code files, and thank you for that 👍. Is it possible to use...
Okay I was also wondering that. Can you add something (if not already present) to the web view (`promptfoo view`) to show the finalized assertion string? That can give me...
Another idea is to add `debug` logging that prints the actual finalized `value` used in the assertion --- Testing with `--output file.yaml`, it doesn't contain the finalized assertion `value`, but...
@typpo I see in 0.25.0 there is a bunch of UI improvements 🥳 love it! Any chance you could add support to the web view to also view finalized expected...
Ha nice, and wow! Just a follow up question, where are the actual assertions there? I am trying to figure out how to do a `similar` assertion on the last...
Okay I am beginning to follow. I think in your example above, the `assert` will fail, because the `assistant` is going to not answer with "hello world". Let's do a...
Okay I see @Peetee06, thanks for clarifying assertions are only done on the last response, that "made it click" for me. So basically if one wants to assert on separate...
Oh yeah that's a lot better, thank you for sharing that!
Hitting this today. > Maybe these factory fields should be annotated with the same type as the model? When I do something like `user: User = factory.SubFactory(UserFactory)`, I get: ```python...
There is a similar issue in the upstream: https://github.com/m-burst/flake8-pytest-style/issues/202