Test GHPRI summarization and fix tools

[aiday-mar]

Refs: https://github.com/microsoft/vscode-internalbacklog/issues/5100

• [ ] anyOS
• [ ] anyOS
• [ ] anyOS

Complexity: 3

Create Issue

---

This iteration we have added a GHPRI chat participant @githubpr which provides some functionality like issue and PR summarization, issue search, notification retrieval and prioritization with an LLM. This TPI is about issue and PR summarization as well as issue fixing with Copilot. To test please do the following:

• Update VS Code and update to the latest GHPRI pre-release version
• Set the hidden setting githubPullRequests.experimental.chat to true
• You can optionally change the value of githubPullRequests.experimental.useQuickChat to decide whether responses should be streamed in the quick chat or in the panel chat. By default the setting is true and command results are streamed in the panel chat.

Issue Summarization

• Go to the GitHub Issues View
• Click on the icon Summarize with Copilot. You should see the following message appear @githubpr Summarize issue microsoft/vscode#<number> in either the quick chat or the panel chat.
• Read the summary from Copilot. Is the summary coherent, concise and correct? Can it be improved?
• Go to the panel chat/quick chat. Choose a GitHub issue associated to one of your open repos and ask the githubpr participant to summarize it. Currently the participant can not summarize issues in repos you don't have open.
• You can type for example:

@githubpr summarize https://github.com/microsoft/vscode/issues/231820

• Read the summary, is the summary coherent, concise and correct? Can it be improved?
• Repeat the above for several issues.

Pull Request Summarization

• Go to the GitHub Pull Request View
• Click on the icon Summarize with Copilot. You should see the following message appear @githubpr Summarize PR microsoft/vscode#<number> in either the quick chat or the panel chat.
• Read the summary from Copilot. Can it be improved?
• Go to the panel chat/quick chat. Choose a GitHub PR associated to one of your open repos and ask the githubpr participant to summarize it.
• You can type for example:

@githubpr summarize https://github.com/microsoft/vscode/pull/231788

• Read the summary. Can it be improved?
• Repeat the above for several PRs.

Issue Fixing

• Open the GitHub Issues View
• View an issue and click on the sparkle icon Fix with Copilot
• Analyze the fix suggested, can the suggested fix be improved?
• The fix tool uses the codebase tool to get workspace context about the issue. Verify the files referenced are correct and the suggested fix is reasonable.
• Go to the panel chat/quick chat. Choose a GitHub issue associated to one of your open repos and ask the githubpr participant to fix it.
• You can type for example:

@githubpr fix https://github.com/microsoft/vscode/issues/231819

• Read the suggested fix. Can it be improved?
• Repeat the above for several issues.