poe-api-wrapper icon indicating copy to clipboard operation
poe-api-wrapper copied to clipboard

gpt-4(beaver)bot not the real one

Open wingeva1986 opened this issue 2 years ago • 6 comments

Asking the gpt-4(beaver)bot is not the same as using on official website,it acts like chatgpt(3.5)

wingeva1986 avatar Aug 28 '23 06:08 wingeva1986

Can you open the poe.com tab while using the API to check if its sending to gpt-4?

snowby666 avatar Aug 28 '23 12:08 snowby666

I checked the website after using the api. got the result below: Screenshot_20230828_233959_com example hikerview the answer was 3.5 style,which didn't realize that 鲁迅 and 周树人 is the same person.

And then I asked the same question on the website, got different right answer below: Screenshot_20230828_233941_mark via

I think it's the same problem like poe-api. https://github.com/ading2210/poe-api/issues/205

wingeva1986 avatar Aug 28 '23 15:08 wingeva1986

I see. Maybe this bug is related to the OpenAI API on Poe server? I will do a research for this later

snowby666 avatar Aug 28 '23 16:08 snowby666

I see. Maybe this bug is related to the OpenAI API on Poe server? I will do a research for this later

I think it's not a bug but the poe's trick to prevent abusing, because something similar happenned before,which forced all user-built gpt-4 bot downgrade to gpt-3.5.

wingeva1986 avatar Aug 29 '23 03:08 wingeva1986

poe recognizes that it's a request call from an unofficial client and forces it to drop back to version 3.5 response

zp96324511 avatar Aug 29 '23 03:08 zp96324511

截图 2023-11-18 18-23-16 {3801C2BF-D586-DE40-B234-327227B5FB45} 截图 2023-11-18 18-37-22

At first i use chinese ask poe's gpt4 qustion and he tell me he is GPT3.5(The last bit of dialog in the second picture is roughly in Chinese: "I simulated gpt4 based on gpt3"), then, i use english ask poe's gpt4 he tell me he is gpt4. I really hope poe is intentionally blocking me because it detects Chinese users, But poe god forbid fixed the “bug”(in picture 3) that it wasn't gpt4 and deleted the conversation between me and him, which makes me wonder if it is indeed a faked gpt4. But this could all be me, based on the fact that it will delete the dialog I must say that he really is an “excellent gpt4". Of cause poe is not using openai's interface(in https://poe.com/about), if it is poe's own training gpt4 but using earlier data to cause the answer to be wrong is also "understandable".

24-Fahed avatar Nov 18 '23 10:11 24-Fahed

Closing since this is a problem with poe.com itself

snowby666 avatar Jun 26 '24 03:06 snowby666