can-ai-code

can-ai-code copied to clipboard

the-crypt-keeper

Too few questions for senior category

2

Hi! Thanks for a useful benchmark. The separation of quants is great. Am I right in thinking that we currently have [only one](https://github.com/the-crypt-keeper/can-ai-code/blob/main/senior/recursion.yaml) question in the senior category? I'm afraid...

rodion-m

OpenAPI update for text-generation-webui

1

### Update: OpenAPI Integration for text-generation-webui This MR updates the evaluation script to use the OpenAI API with the [text-generation-webui](https://github.com/oobabooga/text-generation-webui). **Workflow** - No changes in the preparation steps. - To...

kisimoff

Please evaluate `Eurus-70b-nca-fixed` and `Eurus-70b-sft-fixed` (first public fine-tunes of base `codellama-70b`!!!)

5

These are very exciting as they are the first (AFAIK) public fine-tuned models of the base `codellama-70b`. The original upload was all messed up as they tried to use the...

jukofyork

Guide on how to evaluate models

1

Im willing to test a few models and share the results. I've looked at the readme, but couldn't wrap my head around how to benchmark a model. Any help would...

kisimoff

the-crypt-keeper

Some interesting and unique capabilities in this one

the-crypt-keeper

- [x] Instead of side-by-side view, default to showing 'both' languages by summing their results - [ ] Replace streamlit table with aggrid - [ ] Multi-select with checkboxes -...

the-crypt-keeper

Currently #1 on the Big Code Model Leaderboard. CodeFuse-CodeLlama-34B also looks worth a look

the-crypt-keeper

the-crypt-keeper