eval-dev-quality
eval-dev-quality copied to clipboard
Ruby support
We want to add language support for Ruby.
- [x] Install Ruby in Docker containers
- [x] Introduce Ruby as a new language
- [x] Register the Ruby language #327
- [x] Implement the
ExecuteTests
method in the Ruby language #327 - [x] Implement write-tests task
- [x] Create "plain" repository for Ruby
- [x] Translate the light repository using a LLM
- [x] Support Ruby in
symflower test
- [x] Implement code_repair task
- [x] Translate the mistakes repository using a LLM
- [x] Implement the
Mistakes
method in the Ruby language - [x] Add missing tests #327
- [x] Implement transpile task
- The transpile repository used examples from the light repository, so no need to translate them again
- [x] Change the way we get the origin/destination languages for transpilation
- [x] The transpile package names must be e.g. for Go
transpile-java
,transpile-ruby
, instead of justtranspile
so it is clear which language we are transpiling from
- [x] The transpile package names must be e.g. for Go
- [x] Add missing tests #327
- [x] Documentation
- [x] Update documentation with new Ruby support #327
- [x] New features #327
- [x] Supported providers
- [x] New Reward points
- [x] Merge fixes #327
Follow-up
- [ ] collect all mistakes and remove duplicates: https://github.com/symflower/eval-dev-quality/pull/326#discussion_r1732496767