Tensorflow is broken on M1 Mac

[bfirsh]

Seeing this when building https://github.com/replicate/cog-examples/tree/main/hello-world:

Adding labels to image...
$ docker run --rm --shm-size 8G r8.im/bfirsh/hello-world-2 python -m cog.command.type_signature
WARNING: The requested image's platform (linux/amd64) does not match the detected host platform (linux/arm64/v8) and no specific platform was requested
2021-11-19 03:27:11.826541: F tensorflow/core/lib/monitoring/sampler.cc:42] Check failed: bucket_limits_[i] > bucket_limits_[i - 1] (0 vs. 10)
qemu: uncaught target signal 6 (Aborted) - core dumped

It's this issue: https://github.com/docker/for-mac/issues/5342 And: https://github.com/tensorflow/tensorflow/issues/52845

[zeke]

See also https://github.com/replicate/cog/issues/273

[zeke]

See also https://github.com/tensorflow/tensorflow/issues/52973

[bfirsh]

We should have a getting started example working. Perhaps we should switch to PyTorch.

[yc-cui]

Any solutions?

[sanschaise]

Just checking if anyone was able to get around this?

[okanji]

Same issue, any solutions?

[xcreateadmin]

same issue on Mac M1

[sentient-22]

same issue on Mac M2

[hongchaodeng]

A workaround is to set environment variable:

export DOCKER_DEFAULT_PLATFORM=linux/amd64

This will force docker run to use linux/amd64 platforn by default on MacOS.

Reference: https://stackoverflow.com/questions/65612411/forcing-docker-to-use-linux-amd64-platform-by-default-on-macos

[hongchaodeng]

I think the best solution we can do in cog is to detect MacOS as the OS and specify linux/amd64 as a fallback.

[mattt]

@hongchaodeng Unfortunately, setting DOCKER_DEFAULT_PLATFORM won't help. The underlying issue is that TensorFlow is compiled to use AVX instructions, but they aren't available. I agree with @bfirsh (https://github.com/replicate/cog/issues/336#issuecomment-1071099038) that we need to rewrite the Getting Started guide to use PyTorch instead.

I can start working on that this week.

[peterpme]

hello! it is in fact true that things break on an M1 mac. are there other ways we can go about testing these things locally until the tutorial is re-written? thank you!