RigidBodySim.jl icon indicating copy to clipboard operation
RigidBodySim.jl copied to clipboard

Remove timing checks from tests

Open tkoolen opened this issue 7 years ago • 3 comments

They're just too flaky.

tkoolen avatar May 30 '18 21:05 tkoolen

Would you guys want a dedicated CI to run performance regressions? We're trying to put such a thing together and am interested in what projects want in.

ChrisRackauckas avatar Jul 29 '18 13:07 ChrisRackauckas

For this issue, it's not really about performance; the current timing checks are with trivial problems where I'm just making sure the solve call doesn't return too quickly when I add a RealtimeRateLimiter or when I send a command to pause simulation for a while.

That said, I'm potentially interested in CI benchmarking. Are you talking about something like NanoSoldier?

tkoolen avatar Jul 29 '18 13:07 tkoolen

Yeah, we're trying to get funding to start running a Nanosoldier for packages.

ChrisRackauckas avatar Jul 29 '18 13:07 ChrisRackauckas