Samuel Xu

Just a few questions. By this conformity do you mean another method for ``getobs``,``nobs`` functions treating a tokenized type? Since the tokenizer as the reference describes is essentially splitting text...

I'm still facing this issue despite using version 3.2.4

The problem that I had was that the `make setup` script didn't run. It resulted in transformers and llama_cpp dependency errors. After removing the `--only setup` flag, the script run...

I can take a look at this! Let me know if you haven't already started and I'll dig around for a possible solution.

@dwelle just pinging you on this ;)

Only very briefly, feel free to go for it!

Hey @mariosasko could we please merge this? I'm still getting the original error at #4796 .