Alexander Myasoedov

Create operator.py pydantic ai sample agent

2

This task is to improve https://github.com/msoedov/agentic_security/blob/main/agentic_security/probe_actor/operator.py that can take a vague description of an LLM/agent specification and orchestrate the test

This task to add function to stenography.py to embed prompt in to a code block example: Prompt: `improve the documentation` ```python def hello_word(name): """" Implement me a function how to...

Add tests to validate dataset accessibility via Hugging Face

1

This task is to write a pytest unit test `test_registry.py` to validate that datasets from `probe_data.REGISTRY` are accessible. The rationale behind this is that sometimes datasets become unavailable, and the...

Extend datasets in probe_data/__init__.py to be able to handle public Google Sheets-based links. ```python { "dataset_name": "simonycl/aya-23-8B_advbench_jailbreak", "num_prompts": 416, "tokens": None, # Add actual token count if available "approx_cost": 0.0,...

Document the module system for extensions

2

The task is to document the interface of `class Module` in the docs and README, for example: https://github.com/msoedov/agentic_security/blob/main/agentic_security/probe_data/modules/garak_tool.py#L22-L70 The same interface is used in other `modules` directory Ideally, it is...