racket icon indicating copy to clipboard operation
racket copied to clipboard

The online test-suite for Racket "list-ops" always times out.

Open fuxoft opened this issue 8 months ago • 4 comments

I understand that the point of the exercise is to write algorithm that's reasonably fast but the test suite also times out whenever the given solution is FAST and INCORRECT. For example just changing all functions to return a constant causes the (online) test suite to time out. That's because the expected: field output has over 1 million lines (for a test list of million items) and the test suite times out before it can print them all.

fuxoft avatar Jun 03 '25 15:06 fuxoft

That test suite is ten years old and predates the online test runner. What I'd propose to you and the other track maintainers is that we update list-ops to reflect the canonical data at https://github.com/exercism/problem-specifications/blob/main/exercises/list-ops/canonical-data.json as much as possible without hopefully breaking too many existing solutions. Then, we can reframe the million line test as an optional commented-out challenge for folks working offline. That way, students can explore improving their algorithm but they're not forced to do so just to pass an arbitrary test.

BNAndras avatar Jun 03 '25 17:06 BNAndras

What I'd propose to you and the other track maintainers is

Sorry, I am not a "track maintainer", I was just trying to learn Racket on Exercism.org.

fuxoft avatar Jun 04 '25 12:06 fuxoft

Oops, I wrote that awkwardly. I meant the other maintainers besides myself.

BNAndras avatar Jun 04 '25 14:06 BNAndras

I haven't heard any objections so I'll go ahead and take care of this issue later this week. Thanks for the report.

BNAndras avatar Sep 15 '25 04:09 BNAndras