auto-code-rover icon indicating copy to clipboard operation
auto-code-rover copied to clipboard

Add Groq API

Open KasaiHarcore opened this issue 1 year ago • 1 comments

KasaiHarcore avatar May 07 '24 09:05 KasaiHarcore

I don't know if llama2-70b-4096 is still supported. Doc of groq says it's not, while litellm says otherwise.

Can you confirm if it's supported by running this code? I can't do it myself because I don't have a key.

crhf avatar May 14 '24 16:05 crhf

Hi @KasaiHarcore I just tested the llama3 70B, removed the llama 2 instance and noted down that context lengths may be an issue. Thanks for the contribution!

Marti2203 avatar Jun 08 '24 10:06 Marti2203

No problem, thanks for your reply. Keep up the good work 😍

Vào Th 7, 8 thg 6, 2024 vào lúc 17:44 Martin Mirchev < @.***> đã viết:

Hi @KasaiHarcore https://github.com/KasaiHarcore I just tested the llama3 70B, removed the llama 2 instance and noted down that context lengths may be an issue. Thanks for the contribution!

— Reply to this email directly, view it on GitHub https://github.com/nus-apr/auto-code-rover/pull/39#issuecomment-2155984617, or unsubscribe https://github.com/notifications/unsubscribe-auth/A3M2LFAHFSLCS7YZNJINW5DZGLOBHAVCNFSM6AAAAABHKS6RO6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCNJVHE4DINRRG4 . You are receiving this because you were mentioned.Message ID: @.***>

KasaiHarcore avatar Jun 08 '24 13:06 KasaiHarcore