mcp
mcp copied to clipboard
[Tool Description] Improve Azure Quick Review tool description for better LLM selection
Problem
The current Azure Quick Review (azqr) tool description is functional and above target confidence score (~0.6-0.7), but could be improved for even better LLM tool selection precision.
Current Description Issues:
- Missing usage guidance for when NOT to use
- Limited context about compliance frameworks and security standards
- Could expand on parameter options and report formats
- Missing information about what resources/configurations are analyzed
- Could better explain the value proposition of compliance reporting
Current Description
Runs Azure Quick Review CLI (azqr) commands to generate compliance/security reports for Azure resources. This tool should be used when the user wants to identify any non-compliant configurations or areas for improvement in their Azure resources. Requires a subscription id and optionally a resource group name. Returns the generated report file's path. Note that Azure Quick Review CLI (azqr) is different from Azure CLI (az).
Suggested Improvement
Runs Azure Quick Review CLI (azqr) commands to generate comprehensive compliance and security assessment reports for Azure resources against industry best practices and security frameworks. Use this tool when you need to audit Azure resource configurations, identify security vulnerabilities, assess compliance posture, generate governance reports, or find configuration drift and areas for improvement across Azure subscriptions and resource groups. This tool analyzes Azure resources against security baselines, compliance standards, and operational best practices to provide actionable recommendations. Do not use this tool for real-time monitoring, individual resource management, Azure CLI operations, or deployment tasks - this tool focuses on compliance assessment and security analysis rather than resource operations. The tool requires a subscription ID and optionally accepts a resource group name to scope the analysis. It generates detailed compliance reports in various formats and returns the report file path for further analysis. Note that Azure Quick Review CLI (azqr) is a specialized compliance tool different from the standard Azure CLI (az) and focuses specifically on security and compliance assessment rather than general Azure management.
Acceptance Criteria
- [ ] Update tool description to include clear usage guidance
- [ ] Explain compliance and security assessment context
- [ ] Clarify when NOT to use this tool (vs monitoring, management)
- [ ] Detail the specific compliance and security analysis capabilities
- [ ] Mention industry standards and best practices assessment
- [ ] Maintain distinction from Azure CLI
- [ ] Achieve confidence score >0.7 in tool selection testing
Related: Tool description review for improved LLM selection accuracy
Copied from https://github.com/Azure/azure-mcp/issues/849