codefuse-evaluation

codefuse-evaluation copied to clipboard

Inquiry about Evaluating Code Assistant Products with CodeFuse-AI Evaluation Benchmarks

1

Hi, CodeFuse-AI team, I am interested in evaluating several code assistant products. However, I do not possess a large-scale code model of my own. Instead, what I have are the...

theshyPika

是不是可以增加基于api的测试

1

我需要测试openai的能力

luckfu

This work is very exciting!

zhimin-z

Add natural language to code evaluation language dataset for Java and JavaScript.

HotSummer888

# Add Comprehensive Python Testing Infrastructure ## Summary This PR establishes a complete testing infrastructure for the CodeFuse evaluation framework, transitioning from basic requirements.txt dependency management to a modern Poetry-based...

llbbl