eval-dev-quality
eval-dev-quality copied to clipboard
Do not copy assessments of base tasks
Please help us keep the number of duplicated issues small.
- [x] I have searched the existing issues for my problem.
Brief Description
The write-tests-symflower-template task is based on the write-tests task. As such it inherits all the assessments of the base task.
If a certain language does not support templates, then it still inherits the assessments, which leads to wrong assessments.
Reproducer
No response
Logs
Additional Information
No response
Version
1.0
There are two problems here:
- The assessments should not be copied. They are their own task completely. Own queries execution and everything. they only share repository and case, and maybe some other data.
- If a language doesn't support a feature for a task, it should not be executed at all