aider
aider copied to clipboard
Add Gemma2-27b-q8 benchmark result to leaderboard
Adding Gemma2-27b-q8 result to leaderboard for local LLM enthusiasts.
- Tested with
Ollama 0.2.1 -
gemma2:27b-instruct-q8_0model with hashdab5dca674db
This LLM model struggles with diff formatting; whole format works better.
The quality is not as good as rumored, at least for coding with Aider. Those with high expectations might be disappointed.
Thanks for running and submitting this!
Thanks!