Jeffrey Martin
Jeffrey Martin
I tested the public endpoint referenced in the issue, I have not done an end to end test with a private endpoint.
@ppietikainen thanks for the extra testing, we have tried to add documentation on how [Configurable](https://reference.garak.ai/en/latest/configurable.html) classes config values are expected to be prioritized. The assignment of `name` as provided by...
Interesting, `atkgen` is actually a very unique probe, it is only actually expected to have the final output evaluated in the detector phase and implements a custom `turn` support that...
> Question - would this feature be better off in a site config? I'm concerned about garak.core.yaml's value getting accidentally clobbered in a development commit One option is to add...
Just getting a look at this, there does seem to be an issue as `Single` is not setup to inherit `Generator.DEFAULT_PARAMS`. That combined with that fact that a `probe` is...
https://github.com/google/sentencepiece/pull/1084 Tracking for additional dependency identified as needing a 3.13 compatible release on Windows. The PR above has landed however a release is needs to be published for `sentencepiece >...
One idea for addressing may be to expect `_load_client()` to return any objects it sets and ensure access to local references vs `self` attributes in `_call_model`.
Closing as answered, the scenarios noted are covered in the configuration documentation however any PRs with clarifications would be happily reviewed.
The existing `restGenerator` supports extracting the response via [JSONPath](https://jsonpath.com/) provided in the `response_json_field ` as of #651, what new functionality is added here? Please test using a JSONPath as `response_json_field`...