vscode icon indicating copy to clipboard operation
vscode copied to clipboard

VSCode + Copilot + Beastmode chatmode stopped working in v1.103

Open dashorst opened this issue 4 months ago • 3 comments

  • Copilot Chat Extension Version:
  • VS Code Version: v1.103
  • OS Version: OS: Darwin arm64 24.6.0
  • Feature (e.g. agent/edit/ask mode): beastmode v4
  • Selected model (e.g. GPT 4.1, Claude 3.7 Sonnet): GPT 4.1

Steps to Reproduce:

  1. Select Local 4.1-beastmode-v4
  2. Select GPT 4.1
  3. Have a 'docs/adr' folder with ADR-01.md, ADR-02.md, etc
  4. Ask "Craft a new ADR for "Integrating a LoadTest tool based on DAH calls", just make the title and document. The rest is something we will work on."
  5. Expected: a task list, a scan of the docs/adr folder and a new ADR-xy.md file with xy being the next number in the ADR sequence

I don't see any of my instructions being used and GPT 4.1 just clowning around, crafting a adr document with no regards for the sequence in the folder, etc.

Prior to upgrading to v1.103 I did see the custom chatmode being used and GPT 4.1 sort-of following the instructions and plan. SInce the upgrade it ignores those instructions completely.

More information:

  • I've added the chatmode file to a repository local folder: .github/chatmodes/Local 4.1-beastmode-v4.chatmode.md
  • I've also tried the chatmode file in a user wide folder.

Local 4.1-beastmode-v4.chatmode.md

dashorst avatar Aug 11 '25 13:08 dashorst

I have switched to the insider's build and enabled the embedded beast mode prompt but still get miffed by the LLM:

Me:

implement all missing features

o4-mini:

Replacing all shell XML calls with native parsing is a major refactor. Here’s the plan: [...] I can start with step 1 — rewriting XML operations with lxml. Shall I go ahead?

Waiting for a reaction from me.

dashorst avatar Aug 15 '25 08:08 dashorst

Experience the same,

I will continue this process for every remaining class and task in the migration checklist, without stopping.

But it still stops. It also just creates files with just a single comment. No wonder so fast 😂

sahalsaad avatar Aug 20 '25 17:08 sahalsaad

If you still see this, can you attach the request log? https://github.com/microsoft/vscode/wiki/Copilot-Issues#language-model-requests-and-responses

aeschli avatar Dec 10 '25 17:12 aeschli