vscode-copilot-release icon indicating copy to clipboard operation
vscode-copilot-release copied to clipboard

worthless answers

Open knightofknee opened this issue 1 year ago • 3 comments

it keeps repeating the same failed solution even if i show that i already implemented it. this is worthless and it seems especially bad compared to regular chatgpt. like it has an ego and an inability to acknowledge its own failures. please drop the ego. (screenshot is of a bonus: reporting this issue was too much data for github apparently? weird) Screenshot 2024-09-27 at 10 12 48 PM

knightofknee avatar Sep 28 '24 03:09 knightofknee

Ditto. The endless going circles with it insisting on repeating the same mistakes I've already told it to stop doing is a tremendous waste of time. It cycles between three or four wrong answers, always forgetting by the third question following what I've already told it repeatedly is wrong and not to do.

This is far beyong this just having some rough edges that need sanding off. This going in endless circles is a 100% waste of user time, absolutely and totally nonconstructive.

And I can't even get it to submit the chat that I wanted to submit feedback about at all. It just opens this issues section in my browser.

EDIT: Even worse, I discovered after posting the above that the dozens of cyclical answers it gave me were total hallucinations. It consistently and repeatedly directly contradicted the truth, and I never knew, until I wasted an enormous amount of time getting what I now know were completely nonsense answers.

I'd been trying to get it to tell me how to access the functions of a calling script from within the scope of a script included with a require statement in node.js. It gave me endless cycle of nonworking answers without ever once telling me that scripts included by require have their own scope and can't access objects outside it. It did show me what I now recognize are parts of the correct solution—passing parameters in the require and having the export in the included script return a function instead of an object—but never explained why it was makng those big, unfamiliar changes to my code, and when I asked, instead of telling me, it 'corrected' them and removed them again, so that the 'solution' it was providing couldn't ever possibly work. I lost a lot of time trying in vain to get Copilot to help me with this, before I finally googled and had a working answer in 2 minutes.

As the thread title says: the entire experience was totally worthless.

kupietools avatar Sep 28 '24 04:09 kupietools

+1 happens to me sometimes

faheemstepsharp avatar Sep 28 '24 20:09 faheemstepsharp

Sorry for the bad experience but something more concrete would help me improve those scenarios. Please share the specific prompts or just share the whole conversation (right click > copy all). You can also email it to me if you prefer.

roblourens avatar Oct 03 '24 18:10 roblourens

This issue has been closed automatically because it needs more information and has not had recent activity. See also our issue reporting guidelines.

Happy Coding!