Gradio Client not working with any multimodal models

[Kamakshi8104]

Describe the bug

I tried using gradio client for models such as LLaVA, Cog-VLM, Video-LLaVA etc but I'm always getting an error: File "/Users/kamakshiramamurthy/miniconda3/envs/out_test/lib/python3.12/site-packages/gradio_client/compatibility.py", line 95, in _predict raise ValueError(result["error"]) ValueError: None

Have you searched existing issues? 🔎

• [X] I have searched and found no existing issues

Reproduction

Using the api for any multimodal model such as: from gradio_client import Client

client = Client("https://liuhaotian-llava-1-6.hf.space/--replicas/z1wes/") result = client.predict( "explain", # str in 'parameter_3' Textbox component "/Users/kamakshiramamurthy/Desktop/image/frame_5.jpg", # filepath in 'parameter_11' Image component "Crop", # Literal['Crop', 'Resize', 'Pad', 'Default'] in 'Preprocess for non-square image' Radio component api_name="/add_text" ) print(result)

Screenshot

No response

Logs

No response

System Info

gradio version: 4.22.0
gradio_client version: 0.13.0

------------------------------------------------
gradio dependencies in your environment:

aiofiles: 23.2.1
altair: 5.2.0
fastapi: 0.110.0
ffmpy: 0.3.2
gradio-client==0.13.0 is not installed.
httpx: 0.27.0
huggingface-hub: 0.21.3
importlib-resources: 6.3.0
jinja2: 3.1.3
markupsafe: 2.1.5
matplotlib: 3.8.3
numpy: 1.26.4
orjson: 3.9.15
packaging: 23.2
pandas: 2.2.1
pillow: 10.2.0
pydantic: 2.6.3
pydub: 0.25.1
python-multipart: 0.0.9
pyyaml: 6.0.1
ruff: 0.3.3
semantic-version: 2.10.0
tomlkit==0.12.0 is not installed.
typer: 0.9.0
typing-extensions: 4.10.0
uvicorn: 0.27.1
authlib; extra == 'oauth' is not installed.
itsdangerous; extra == 'oauth' is not installed.


gradio_client dependencies in your environment:

fsspec: 2024.2.0
httpx: 0.27.0
huggingface-hub: 0.21.3
packaging: 23.2
typing-extensions: 4.10.0
websockets: 11.0.3


(out_test) kamakshiramamurthy@Kamakshis-MacBook-Pro [16:14:57] [~/desktop/GSoC/outline]
-> % pip install gradio-client
Requirement already satisfied: gradio-client in /Users/kamakshiramamurthy/miniconda3/envs/out_test/lib/python3.12/site-packages (0.13.0)
Requirement already satisfied: fsspec in /Users/kamakshiramamurthy/miniconda3/envs/out_test/lib/python3.12/site-packages (from gradio-client) (2024.2.0)
Requirement already satisfied: httpx>=0.24.1 in /Users/kamakshiramamurthy/miniconda3/envs/out_test/lib/python3.12/site-packages (from gradio-client) (0.27.0)
Requirement already satisfied: huggingface-hub>=0.19.3 in /Users/kamakshiramamurthy/miniconda3/envs/out_test/lib/python3.12/site-packages (from gradio-client) (0.21.3)
Requirement already satisfied: packaging in /Users/kamakshiramamurthy/miniconda3/envs/out_test/lib/python3.12/site-packages (from gradio-client) (23.2)
Requirement already satisfied: typing-extensions~=4.0 in /Users/kamakshiramamurthy/miniconda3/envs/out_test/lib/python3.12/site-packages (from gradio-client) (4.10.0)
Requirement already satisfied: websockets<12.0,>=10.0 in /Users/kamakshiramamurthy/miniconda3/envs/out_test/lib/python3.12/site-packages (from gradio-client) (11.0.3)
Requirement already satisfied: anyio in /Users/kamakshiramamurthy/miniconda3/envs/out_test/lib/python3.12/site-packages (from httpx>=0.24.1->gradio-client) (4.3.0)
Requirement already satisfied: certifi in /Users/kamakshiramamurthy/miniconda3/envs/out_test/lib/python3.12/site-packages (from httpx>=0.24.1->gradio-client) (2024.2.2)
Requirement already satisfied: httpcore==1.* in /Users/kamakshiramamurthy/miniconda3/envs/out_test/lib/python3.12/site-packages (from httpx>=0.24.1->gradio-client) (1.0.4)
Requirement already satisfied: idna in /Users/kamakshiramamurthy/miniconda3/envs/out_test/lib/python3.12/site-packages (from httpx>=0.24.1->gradio-client) (3.6)
Requirement already satisfied: sniffio in /Users/kamakshiramamurthy/miniconda3/envs/out_test/lib/python3.12/site-packages (from httpx>=0.24.1->gradio-client) (1.3.1)
Requirement already satisfied: h11<0.15,>=0.13 in /Users/kamakshiramamurthy/miniconda3/envs/out_test/lib/python3.12/site-packages (from httpcore==1.*->httpx>=0.24.1->gradio-client) (0.14.0)
Requirement already satisfied: filelock in /Users/kamakshiramamurthy/miniconda3/envs/out_test/lib/python3.12/site-packages (from huggingface-hub>=0.19.3->gradio-client) (3.13.1)
Requirement already satisfied: requests in /Users/kamakshiramamurthy/miniconda3/envs/out_test/lib/python3.12/site-packages (from huggingface-hub>=0.19.3->gradio-client) (2.31.0)
Requirement already satisfied: tqdm>=4.42.1 in /Users/kamakshiramamurthy/miniconda3/envs/out_test/lib/python3.12/site-packages (from huggingface-hub>=0.19.3->gradio-client) (4.66.2)
Requirement already satisfied: pyyaml>=5.1 in /Users/kamakshiramamurthy/miniconda3/envs/out_test/lib/python3.12/site-packages (from huggingface-hub>=0.19.3->gradio-client) (6.0.1)
Requirement already satisfied: charset-normalizer<4,>=2 in /Users/kamakshiramamurthy/miniconda3/envs/out_test/lib/python3.12/site-packages (from requests->huggingface-hub>=0.19.3->gradio-client) (3.3.2)
Requirement already satisfied: urllib3<3,>=1.21.1 in /Users/kamakshiramamurthy/miniconda3/envs/out_test/lib/python3.12/site-packages (from requests->huggingface-hub>=0.19.3->gradio-client) (2.2.1)
(out_test) kamakshiramamurthy@Kamakshis-MacBook-Pro [16:15:40] [~/desktop/GSoC/outline]
-> % gradio environment
Gradio Environment Information:
------------------------------
Operating System: Darwin
gradio version: 4.22.0
gradio_client version: 0.13.0

------------------------------------------------
gradio dependencies in your environment:

aiofiles: 23.2.1
altair: 5.2.0
fastapi: 0.110.0
ffmpy: 0.3.2
gradio-client==0.13.0 is not installed.
httpx: 0.27.0
huggingface-hub: 0.21.3
importlib-resources: 6.3.0
jinja2: 3.1.3
markupsafe: 2.1.5
matplotlib: 3.8.3
numpy: 1.26.4
orjson: 3.9.15
packaging: 23.2
pandas: 2.2.1
pillow: 10.2.0
pydantic: 2.6.3
pydub: 0.25.1
python-multipart: 0.0.9
pyyaml: 6.0.1
ruff: 0.3.3
semantic-version: 2.10.0
tomlkit==0.12.0 is not installed.
typer: 0.9.0
typing-extensions: 4.10.0
uvicorn: 0.27.1
authlib; extra == 'oauth' is not installed.
itsdangerous; extra == 'oauth' is not installed.


gradio_client dependencies in your environment:

fsspec: 2024.2.0
httpx: 0.27.0
huggingface-hub: 0.21.3
packaging: 23.2
typing-extensions: 4.10.0
websockets: 11.0.3

Severity

Blocking usage of gradio