bigcodebench icon indicating copy to clipboard operation
bigcodebench copied to clipboard

🐛 [TaskRemoval/TaskRepair] - <120> <Unexpected test cases>

Open bajinsheng opened this issue 6 months ago • 0 comments

BigCodeBench version

1.0.4

Output of running ls ~/.cache/bigcodebench

BigCodeBench-Hard-v0.1.4.jsonl

Task ID of the programming task

BigCodeBench/120

The original complete prompt

For the test case:

    def test_series_length(self):
        start_date = datetime(2020, 1, 1)
        end_date = datetime(2020, 1, 10)
        dates = task_func(start_date, end_date)
        self.assertEqual(len(dates), (end_date - start_date).days)

Your proposed new complete prompt

It expects the len(date) is 9. However, according to the prompt: "including both start_date and end_date" "The series length matches the number of days in the specified range.", it should be 10 days.

Other context

No response

bajinsheng avatar Aug 08 '25 20:08 bajinsheng