mcp
mcp copied to clipboard
[Tool Description] Improve Load Testing tool description for better LLM selection
Problem
The current Load Testing tool description is functional but lacks the detail and clarity needed for optimal LLM tool selection. Estimated confidence score of ~0.5-0.6 (at target but could be improved for better precision).
Current Description Issues:
- Missing usage guidance (when to use vs when not to use)
- Limited context about Azure Load Testing vs other testing approaches
- Poor parameter explanation
- Missing scale and limitation details
- Formatting issues (missing space after period)
- No mention of supported test types or protocols
Current Description
Load Testing operations - Commands for managing Azure Load Testing resources, test configurations, and test runs. Includes operations for creating and managing load test resources, configuring test scripts, executing performance tests, and monitoring test results.This tool is a hierarchical MCP command router. Sub commands are routed to MCP servers that require specific fields inside the "parameters" object. To invoke a command, set "command" and wrap its args in "parameters". Set "learn=true" to discover available sub commands.
Suggested Improvement
Load Testing operations - Commands for managing Azure Load Testing service for high-scale performance testing of web applications, APIs, and microservices using JMeter-compatible test scripts. Use this tool when you need to create load testing resources, configure performance test scenarios, execute stress tests with simulated user loads, monitor test execution progress, or analyze performance test results for applications under load. This tool supports HTTP/HTTPS load testing with configurable virtual users and duration. Do not use this tool for unit testing, integration testing, Azure Monitor performance monitoring, or application debugging - this tool focuses specifically on load and performance testing scenarios with simulated traffic. This tool is a hierarchical MCP command router where sub-commands are routed to MCP servers that require specific fields inside the "parameters" object. To invoke a command, set "command" and wrap its arguments in "parameters". Set "learn=true" to discover available sub-commands for different load testing operations including test creation, execution, and result analysis. Note that this tool requires appropriate Azure Load Testing permissions and may incur costs based on test scale and duration.
Acceptance Criteria
- [ ] Update tool description to include clear usage guidance
- [ ] Explain Azure Load Testing's performance testing context
- [ ] Clarify when NOT to use this tool (vs other testing/monitoring tools)
- [ ] Detail the specific load testing operations available
- [ ] Mention scale capabilities and cost implications
- [ ] Fix formatting issues
- [ ] Achieve confidence score >0.6 in tool selection testing
Related: Tool description review for improved LLM selection accuracy
Copied from https://github.com/Azure/azure-mcp/issues/832