tinygrad not opening the chat link

[CNA79]

Installed on macpro M1 Max and the text one works good however the chat api is not working, any ideas on how to fix it?

Detected system: Apple Silicon Mac Inference engine name after selection: mlx Using inference engine: MLXDynamicShardInferenceEngine with shard downloader: SingletonShardDownloader [51334, 52920, 65227, 64045, 50842] Chat interface started:

• http://127.0.0.1:52415
• http://192.168.0.144:52415 ChatGPT API endpoint served at:
• http://127.0.0.1:52415/v1/chat/completions
• http://192.168.0.144:52415/v1/chat/completions has_read=True, has_write=True

http://192.168.0.144:52415/v1/chat/completions

This site can’t be reached The webpage at http://192.168.0.144:52415/v1/chat/completions might be temporarily down or it may have moved permanently to a new web address. ERR_INVALID_RESPONSE

[AlexCheema]

the web interface is on http://127.0.0.1:52415/

[CNA79]

the web interface is on http://127.0.0.1:52415/

Hi Alex

The web interface works fine, wanted to use the chat version and that one does not work, there are no error messages either or I do not know where to look properly

[AlexCheema]

the web interface is on http://127.0.0.1:52415/

Hi Alex

The web interface works fine, wanted to use the chat version and that one does not work, there are no error messages either or I do not know where to look properly

The chat one is an API endpoint. You can use it like so:

curl http://localhost:52415/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{
     "model": "llama-3.2-3b",
     "messages": [{"role": "user", "content": "What is the meaning of exo?"}],
     "temperature": 0.7
   }'

[Evanev7]

Fixed in 1.0 - we dont use tinygrad in the rewrite.