Tushar Raskar

voicecraft gradio colab not working

2

assert _checkpoint_path is not None, f"Could not resolve compression model checkpoint path: {checkpoint_path}" AssertionError: Could not resolve compression model checkpoint path: /content/VoiceCraft/pretrained_models/encodec_4cb2048_giga.th

[Bug]: vllm not working in lightllm

2

### Your current environment import litellm litellm.set_verbose=True import litellm response = litellm.completion( model="vllm/microsoft/Phi-3-small-8k-instruct", messages="who is the PM of India", temperature=0.2, trust_remote_code=True, max_tokens=80 ) print(response) ### 🐛 Describe the bug Give...

[Usage]: In phi3 vision maximum context length issue

1

### Your current environment llm = VLLMOpenAI( openai_api_key="EMPTY", openai_api_base=api_base, model_name="microsoft/Phi-3-vision-128k-instruct", model_kwargs={"stop": ["."]} ) image_path = "invoice_data_images/Screenshot 2024-05-02 160946_page_1.png" with open(image_path, "rb") as image_file: image_base64 = base64.b64encode(image_file.read()).decode("utf-8") prompt_1 = "Give me...