luijait comments

Results 4 comments of


                                            luijait

RuntimeError: Error(s) in loading state_dict for MistralForCausalLM (Deepspeed Zero 3)

I had the same error, the transformer library fixes it, but now I get this one. new_error_msgs, offload_index, state_dict_index = _load_state_dict_into_meta_model( File "/usr/local/lib/python3.10/dist-packages/transformers/modeling_utils.py", line 813, in _load_state_dict_into_meta_model set_module_quantized_tensor_to_device(model, param_name, param_device,...

When calling burp, an error message is displayed in Chinese

It seems to be a bug in the MCP, we will try to fix it in the next version 0.4.0!

OpenAI Integration with HuggingFace API

You can try hugginface_api_key and use huggingface/meta-flame/flame as your model name... https://docs.litellm.ai/docs/providers/huggingface

[non-fatal] Tracing client error 403: {"error":{"code":"unsupported_country_region_territory","message":"Country, region, or territory not supported","param":null,"type":"request_forbidden"}}

> Hello, I am a user in Hong Kong. Due to OpenAI's regional restrictions, I cannot access OpenAI. Even if I use DeepSeek LLM, the program still gives me a...