serving
serving copied to clipboard
tensorflow
Apple M1 support
Feature Request
Describe the problem the feature is intended to solve
TensorFlow is promoting Apples M1 Macs, would be great to have TFServing running on M1 Macs as well https://blog.tensorflow.org/2020/11/accelerating-tensorflow-performance-on-mac.html
Once M1 is officially supported by TF, we can try and provide (docker/m1) builds for TF Serving.
Presently M1 builds in TF is driven by community supported builds.
This would be much appreciated. I almost got TF Serving running on m1 in minikube (using this image https://github.com/emacski/tensorflow-serving-arm) but hit this error on start:
2021-05-31 12:46:35.956430: F tensorflow/core/lib/monitoring/sampler.cc:42] Check failed: bucket_limits_[i] > bucket_limits_[i - 1] (0 vs. 10)
Once M1 is officially supported by TF, we can try and provide (docker/m1) builds for TF Serving.
Presently M1 builds in TF is driven by community supported builds.
Hi @netfs do you happen to know where a tensorflow serving community build can be found?
Is there an ETA for this to become available? This is blocking M1 Mac users from running tfs on docker for development.
Hi there,
I'm able to run Tensorflow Serving on my M1 by using this custom build: https://github.com/emacski/tensorflow-serving-arm
docker pull emacski/tensorflow-serving:latest-linux_arm64
docker run -t --rm -p 8501:8501 --mount type=bind,source=/tmp/model_name/,target=/models/model_name/ -e MODEL_NAME=model_name emacski/tensorflow-serving:latest-linux_arm64
(replace /tmp/model_name by your model's directory)
For those who are stuck, check out
Solution 1:
FROM emacski/tensorflow-serving:2.5.1
....your logic here...
Alternative (if you want to install TensorFlow in docker):
FROM --platform=linux/x86_64 python:3.9
RUN python -m pip install --upgrade pip
RUN pip install tensorflow==2.6.2
We are currently working on this issue, and will have an update in the fairly near future. In the meantime, some users have reported success with Rosetta. Other options include using a VM. We understand that neither of those is ideal.
At the moment we don't have ETA but you can check update about Mac M1 support on Tensorflow Forum here
Thank you!
I want to thank you for this comment! I managed to get this working with the above on my M2 Mac for local development.
more than 3 years and TF serving is still not working. Google, please do better!
