Aaron Pham

You shouldn't run openllm with sudo first and foremost, try again without sudo

This seems like the weirdest bug to me. `orjson` is a core dependency and should already include during install openllm in the container? Would you mind running `bentoml containerize ......

I discover a bug on main and I will release a new version patch version promptly

can you try with 0.1.9 to see if you still run into this issue?

you need to provide `bentoml containerize --opt no-cache` to remove the previous cache layer. It will still use the previous cache hit afaik

Hey there, I have identified the issue and will have a patch release soon. sorry for the trouble

v0.1.10 will address this issue. Thanks for spotting this!

Did you still run into this issue?

are you seeing this with dolly, or with both? I have tested OPT on my end, on both linux and macos and it startup just fine

Hey, I have fixed this issue on main and will release a patch version soon.