zed icon indicating copy to clipboard operation
zed copied to clipboard

Agent Panel: Claude Sonnet 4 (github copilot version) can't read images

Open aymennasri opened this issue 7 months ago • 14 comments

Summary

When reading an image, this error occurs: Attempted to read an image, but Zed doesn't currently sending images to Claude Sonnet 4.

Steps to trigger the problem:

  1. Insert image from workspace for Claude Sonnet 4 to read
  2. The tool calling of reading the image fails and displays the previous error message

Zed Version and System Specs

Zed: v0.187.8 (Zed) OS: Linux X11 linuxmint 22.1 Memory: 31 GiB Architecture: x86_64 GPU: Quadro T2000 || NVIDIA || 565.77

aymennasri avatar May 23 '25 18:05 aymennasri

Image

This is a limitation from copilot side. They don't support images on sonnet 4 yet. If it gets added you will be able to add images as context which can then read by the agent.

imumesh18 avatar May 23 '25 19:05 imumesh18

Stupid question, but how did you select Claude Sonnet 4 from the Github Copilot models? Is this already supported in Zed?

Image

nilskch avatar May 24 '25 12:05 nilskch

Stupid question, but how did you select Claude Sonnet 4 from the Github Copilot models? Is this already supported in Zed?

Image

Yeah, it is supported and it should be listed in Zed either way, just make sure to enable the model in the copilot settings on github and maybe update Zed as well.

Edit: I see your problem now, just select the hidden item at the end of the list, it's a weird visual bug on Zed that I noticed (you can use the scrollbar to reach the "true" end of the list to see Sonnet 4)

aymennasri avatar May 24 '25 12:05 aymennasri

just make sure to enable the model in the copilot settings on github

My copilot subscription is managed and paid for by my employer, and it looks like Claude Sonnet 4 is not yet enabled. Thanks!

There is no hidden item like in #31333 for me...

nilskch avatar May 24 '25 13:05 nilskch

No idea how enterprise subscriptions work, but you can test whether it's available or not on github's website directly using the Chat with Copilot feature to confirm what you just said.

aymennasri avatar May 24 '25 13:05 aymennasri

Same issue for me.

lucasvperini avatar May 24 '25 17:05 lucasvperini

Hmm, I also can't see Claude 4 Sonnet (Preview) using Copilot, I do have it enabled, I can chat with it in Copilot chat.

hjemmel avatar May 27 '25 04:05 hjemmel

#31333 doesn't fix your problem?

aymennasri avatar May 27 '25 11:05 aymennasri

#31333 doesn't fix your problem?

Hey @aymennasri nvm, it is showing up now after I updated Zed!

hjemmel avatar May 28 '25 00:05 hjemmel

It seems this is happening to me in Zed preview version 0.189.1 Image

Is not fixed by scrolling down #31333

https://github.com/user-attachments/assets/63a4a2ee-9f29-4df3-9bfa-75ba37ae33b6

But with my same account using Zed 0.188.3 is working fine:

Image

chsanch avatar May 29 '25 19:05 chsanch

I also have a similar problem. Claude 4 was always there on the GitHub website and in Visual Studio Code, but it disappeared from zed after updating at a certain point.

Xyndra avatar May 30 '25 10:05 Xyndra

If that's the case of many of you, you should open a separate issue.

aymennasri avatar May 30 '25 16:05 aymennasri

I just pulled the latest commit and it has appeared again, seems like it was fixed (looking at the recent commits, seems to have been a side-effect though)

Xyndra avatar May 30 '25 21:05 Xyndra

Is fixed now, I think by #31751

chsanch avatar May 31 '25 15:05 chsanch

We added support for attaching images when using Copilot Chat, closing. Image

@Xyndra @nilskch

To make Claude 4 Models show up in Zed you need to enable them in the Copilot settings on Github under https://github.com/settings/copilot/features

Image

bennetbo avatar Jun 17 '25 16:06 bennetbo