MurphyS
MurphyS
一样的,用了上述方法也不好使,不知道哪里出了问题?
> Which Mac are you running, and how is the performance? @holmbuar Mac mini m4 16G and 7b doesn't work, 1b works but take around 10 seconds for text generation,...
> > It works on Apple silicon with the changes in this fork. However, In app_januspro.py, you need to make sure the dtype for "mps" is also bfloat16 in order...
> > > Which Mac are you running, and how is the performance? > > > > > > [@holmbuar](https://github.com/holmbuar) Mac mini m4 16G and 7b doesn't work, 1b works...
> It works on Apple silicon with the changes in this fork. However, In app_januspro.py, you need to make sure the dtype for "mps" is also bfloat16 in order to...
> > > > > Which Mac are you running, and how is the performance? > > > > > > > > > > > > [@holmbuar](https://github.com/holmbuar) Mac mini...
I had same problem on Mac, finally use some tricks to solve this: `brew install protobuf sentencepiece pkg-config cmake` update your pip and change the SentencePiece==0.2 in pyproject.toml I have...
I had same problem on mac and here's my solution for reference: https://github.com/takahirosir/Janus/commit/ff1e732981695b08c35f7356e04c89bb925906bf#diff-1b6c4cb1987bfffe1eba923c8b618df435472bfa1544712d10e491cd3b852c93