exo-explore
why exo version in ubuntu is 0.0.1?
why exo version in ubuntu is 0.0.1?and not support deepseek in tinychat?
#ubuntu 22.04 (.venv) root@0-110-gpu:~/exo# python3 get_exo_version.py exo version: 0.0.1
#not support deepseek in ubuntu
(.venv) root@0-110-gpu:~/exo# curl http://192.168.0.110:52415/v1/chat/completions
-H "Content-Type: application/json"
-d '{
"model": "deepseek-r1-distill-llama-8b-8bit",
"messages": [{"role": "user", "content": "What is the meaning of exo?"}],
"temperature": 0.7
}'
{"detail": "Unsupported model: deepseek-r1-distill-llama-8b-8bit with inference engine TinygradDynamicShardInferenceEngine. Supported models for this engine: ['llama-3.3-70b', 'llama-3.2-1b', 'llama-3.2-1b-8bit', 'llama-3.2-3b', 'llama-3.2-3b-8bit', 'llama-3.2-3b-bf16', 'llama-3.1-8b', 'llama-3.1-70b', 'llama-3.1-70b-bf16', 'llama-3-8b', 'llama-3-70b']"}
I hope exo can support the deployment of Deepseek models on Ubuntu as soon as possible. It's really disappointing. After going through all the trouble to reach the final step of deployment, I found out that only Mac computers can load more models other than Llama.
I think exo is the best AI tool. I hope the engineers can provide more support for Ubuntu so that more engineers can get involved.