GPULlama3.java icon indicating copy to clipboard operation
GPULlama3.java copied to clipboard

Add Basic Error Handling for Missing Model Files

Open mikepapadim opened this issue 6 months ago • 4 comments

Description:

Add proper error messages when files like tokenizer.model or consolidated.00.pth are missing.

Why it helps: Prevents unclear FileNotFoundException stack traces.

same for non-Llama3 or Mistral models

mikepapadim avatar Jun 09 '25 11:06 mikepapadim

Hi @mikepapadim, could you assign this issue to me? Would like to get introduced to the project.

dhruvarayasam avatar Jun 21 '25 21:06 dhruvarayasam

Hey @mikepapadim , wanted to get more context on this issue. I added some error handling in the loadModel method of the GGUF class that checks for the existence of the file at modelPath. However, I was wondering if I could get some indication for where I should be checking for tokenizer.model, consolidated.00.pth and other relevant files.

dhruvarayasam avatar Jun 24 '25 00:06 dhruvarayasam

Hello @dhruvarayasam , thank you for your intend to contribute. I think this issue is not relevant at this point as we it will be a problem once we add model of other types that are not supported yet in the current version.

mikepapadim avatar Jun 25 '25 11:06 mikepapadim

No worries, in that case will just submit a PR for what I have so far and you can let me know if there's anything I should tweak.

dhruvarayasam avatar Jun 27 '25 02:06 dhruvarayasam