pytorch-xla and lib-tpu version mismatch with latest nightly image

Open jialei777 opened this issue 4 months ago • 3 comments

🐛 Bug

ValueError: Failed to deserialize the Mosaic module: INTERNAL: Unsupported version: expected <= 7 but got 8

when running xpk e2e test with torchprime with 20250827 nightly image.

Can be fixed by re-installing torch_xla via https://github.com/AI-Hypercomputer/torchprime/pull/380/files#diff-bb5a1cd275bb54cbd2f4f040092a1955f73f34573c29720dba9fb4e864b8ca4bR28-R34

Seems this happens for all images after 20250709.

Sep 03 '25 00:09 jialei777

cc @bhavya01

Sep 03 '25 15:09 ysiraichi

@jialei777 Is this fixed after upgrading to 0827 nightly?

Sep 04 '25 17:09 bhavya01

no, it run into

ValueError: Failed to deserialize the Mosaic module: INTERNAL: Unsupported version: expected <= 7 but got 8

this error with 20250827 image. I have to reinstall torch_xla to hack it.

Sep 04 '25 17:09 jialei777