ClassEval icon indicating copy to clipboard operation
ClassEval copied to clipboard

Benchmark Solution Code does not achieve 100%

Open twitchy0 opened this issue 6 months ago • 0 comments

I was able to achieve 100% with the benchmark code after disabling the following tests and patching test 56. Some of the tasks have an explicit test case while others appear to be exact float comparison failures. Another test had a timeout.

[
    17, 
    35,
    52, # possible nltk data download issue
    31, # exact float check
    46,
    48,
    22,
    34,
    38,
    43,
    44,
    69,
    93,
]

twitchy0 avatar Aug 06 '24 18:08 twitchy0