Enable running tests in parallel

Open hoytak opened this issue 1 year ago • 2 comments

The main issue is that git xet clone with a single mdbv1 is not process safe -- two tests trying to read from a remote mdbv1 repo will cause a crash. This fixes that specific issue by merging the mdbv1 tests into a single test that would not be run in parallel.

The result is a significant speedup when running pyxet tests.

Jun 07 '24 21:06 hoytak

Edit: Real issue here is the fact that xet blob is not multiprocess safe. That must be fixed before this can be parallelized.

Jun 09 '24 20:06 hoytak

Edit: Real issue here is the fact that xet blob is not multiprocess safe. That must be fixed before this can be parallelized.

Oh! which part is not?

Jun 10 '24 18:06 seanses