Swathi S

Error: in experimentation.ipynb, getting error from get_training_source_query function as list out of range and gca_resource not available.

5

Getting an error as list out of range for get_training_source_query function for public dataset (house price dataset). 

Error while running make chat.

1

Hi @RaymondWang0 , I'm trying to implement this solution on windows(cpu) OS. And the pre-requisites have been met. Model used is LLaMA2_7B_chat_awq_int4 --QM QM_x86 We are getting the same error...

Wrong Model response

1

Hi @meenchen , @RaymondWang0 I'm implementing this tinychat in Windows OS (x86), I'm receiving gibberish response from model. Can i know what is the issue here, is it from model?...

Hi @meenchen , @RaymondWang0 I'm implementing this tinychat tutorial in Windows OS. Follwed the instructions mentioned in the MIT_Efficient_AI_Lab_5_Optimize_LLM_on_Edge document. I've downloaded x86 model. I'm facing error while running ./evaluate.sh...