Arun Gupta

@kevinintel do you have any updates on this?

@XuhuiRen where can I find the docs to try this functionality?

Mac is a common developer platform so adding to the supported roadmap would be very useful.

@daisy-ycguo Here is what I see on my platform: ``` %g++ --version Apple clang version 15.0.0 (clang-1500.3.9.4) Target: arm64-apple-darwin23.5.0 Thread model: posix InstalledDir: /Library/Developer/CommandLineTools/usr/bin ``` What needs to be different?

I used a different model: ``` export LLM_MODEL_ID="deepseek-ai/deepseek-coder-6.7b-instruct" ``` Is there still an access issue with that?

I followed the instructions explained at https://github.com/opea-project/GenAIExamples/tree/main/CodeGen. Should they be updated accordingly?

> > Hi， @arun-gupta When you use **sudo** to execute docker compose up, the environment variables may not be effectively passed, which will cause the tgi service to fail to...

The server log seems to be fine: ``` ubuntu@ip-172-31-52-197:~$ sudo docker logs llm-tgi-server Defaulting to user installation because normal site-packages is not writeable Collecting langserve==0.3.0 (from -r requirements-runtime.txt (line 1))...