eval-dev-quality icon indicating copy to clipboard operation
eval-dev-quality copied to clipboard

Ruby support

Open ahumenberger opened this issue 6 months ago • 3 comments

We want to add language support for Ruby.

  • [x] Install Ruby in Docker containers
  • [x] Introduce Ruby as a new language
  • [x] Register the Ruby language #327
  • [x] Implement the ExecuteTests method in the Ruby language #327
  • [x] Implement write-tests task
    • [x] Create "plain" repository for Ruby
    • [x] Translate the light repository using a LLM
    • [x] Support Ruby in symflower test
  • [x] Implement code_repair task
    • [x] Translate the mistakes repository using a LLM
    • [x] Implement the Mistakes method in the Ruby language
    • [x] Add missing tests #327
  • [x] Implement transpile task
    • The transpile repository used examples from the light repository, so no need to translate them again
    • [x] Change the way we get the origin/destination languages for transpilation
      • [x] The transpile package names must be e.g. for Go transpile-java, transpile-ruby, instead of just transpile so it is clear which language we are transpiling from
    • [x] Add missing tests #327
  • [x] Documentation
    • [x] Update documentation with new Ruby support #327
    • [x] New features #327
      • [x] Supported providers
      • [x] New Reward points
  • [x] Merge fixes #327

Follow-up

  • [ ] collect all mistakes and remove duplicates: https://github.com/symflower/eval-dev-quality/pull/326#discussion_r1732496767

ahumenberger avatar Jul 31 '24 05:07 ahumenberger