VSCode + Copilot + Beastmode chatmode stopped working in v1.103
- Copilot Chat Extension Version:
- VS Code Version: v1.103
- OS Version: OS: Darwin arm64 24.6.0
- Feature (e.g. agent/edit/ask mode): beastmode v4
- Selected model (e.g. GPT 4.1, Claude 3.7 Sonnet): GPT 4.1
Steps to Reproduce:
- Select Local 4.1-beastmode-v4
- Select GPT 4.1
- Have a 'docs/adr' folder with ADR-01.md, ADR-02.md, etc
- Ask "Craft a new ADR for "Integrating a LoadTest tool based on DAH calls", just make the title and document. The rest is something we will work on."
- Expected: a task list, a scan of the docs/adr folder and a new ADR-xy.md file with xy being the next number in the ADR sequence
I don't see any of my instructions being used and GPT 4.1 just clowning around, crafting a adr document with no regards for the sequence in the folder, etc.
Prior to upgrading to v1.103 I did see the custom chatmode being used and GPT 4.1 sort-of following the instructions and plan. SInce the upgrade it ignores those instructions completely.
More information:
- I've added the chatmode file to a repository local folder: .github/chatmodes/Local 4.1-beastmode-v4.chatmode.md
- I've also tried the chatmode file in a user wide folder.
I have switched to the insider's build and enabled the embedded beast mode prompt but still get miffed by the LLM:
Me:
implement all missing features
o4-mini:
Replacing all shell XML calls with native parsing is a major refactor. Here’s the plan: [...] I can start with step 1 — rewriting XML operations with lxml. Shall I go ahead?
Waiting for a reaction from me.
Experience the same,
I will continue this process for every remaining class and task in the migration checklist, without stopping.
But it still stops. It also just creates files with just a single comment. No wonder so fast 😂
If you still see this, can you attach the request log? https://github.com/microsoft/vscode/wiki/Copilot-Issues#language-model-requests-and-responses