mrfakename

Hi, I'm still getting this issue while using both the HF and non-HF models

I found that removing line 88 (`model.generation_config.do_sample = True`) seems to resolve the issue

Thanks!

I’d actually like to support MIT since it allows integration into apps, while still requiring attribution. For the Swiftcord app itself GPL makes sense but for libraries MIT doesn’t require...

FYI [DeciCoder](https://huggingface.co/Deci/DeciCoder-6B) was just released!

Thanks!

FYI looks like the layer names just changed https://huggingface.co/microsoft/phi-2/commit/cb2f4533604d8b67de604e7df03bfe6f3ca22869

Makes sense. Thanks for researching this!

Have you seen Phixtral by @mlabonne ? https://x.com/maximelabonne/status/1744867841436700850

@mlabonne is your Phixtral fork public?