Van Pham

thank you, can you let us know more details of the failed model / step to reproduce? @xx88xx

Quoted from users from janhq/jan#2704: > Problem When a generation is ongoing, entering a new prompt causes the generation to be interrupted. It would be nice if subsequent prompts to...

hi @Propheticus, the issue was resolved in our nightlybuild, would you mind retrying it? thank you

related to: https://github.com/janhq/jan/issues/3374

h‌i there, we are working on a huge refa‌c‌tor of Jan, ‌would you mi‌nd trying again with Jan x Cortex via nightly bui‌‌ld? https://github.com/janhq/jan?tab=readme-ov-file#download Thank you

Hi there, sorry for the inconvenience, due to a roll back in Jan nightly, we are in progress of making Jan support Llama3.1 again, we will keep you posted in...

 tested and looking good uisng Jan v0.5.2-619

Jan 0.5.3 is released to stable version of Jan app: https://github.com/janhq/jan/releases/tag/v0.5.3, feel free to get back to us if any concern

hi @mr-september, - As I tested, the imported gguf model (Starling_Monarch_Westlake_Garten-7B-v0.1-Q2_K) is working. Can you tell us more details about the issue that you are facing? - If the issue...

thank @mr-september, We were able to reproduce the issue using Starling_Monarch_Westlake_Garten-7B-v0.1-IQ4_XS.gguf. Dev team will investigate the issue soon.