whisper.cpp icon indicating copy to clipboard operation
whisper.cpp copied to clipboard

Unsupported device error when using vulkan on android devices

Open Jluanka opened this issue 10 months ago • 2 comments

Hello, i compiled whisper.cpp with vulkan gpu support on my android phone via termux (android terminal emulator) and i get an error saying that my device does not support 16 bit storage. I am wondering if it's possible to fix this issue?

Logs:

~/.../build/bin $ ./whisper-cli -m $HOME/whisper.cpp/models/ggml-medium.bin -f $HOME/whisper.cpp/iman.wav
whisper_init_from_file_with_params_no_state: loading model from '/data/data/com.termux/files/home/whisper.cpp/models/ggml-medium.bin'
whisper_init_with_params_no_state: use gpu    = 1
whisper_init_with_params_no_state: flash attn = 0
whisper_init_with_params_no_state: gpu_device = 0
whisper_init_with_params_no_state: dtw        = 0
ggml_vulkan: Found 1 Vulkan devices:
ggml_vulkan: 0 = Adreno (TM) 640 (Qualcomm Technologies Inc. Adreno Vulkan Driver) | uma: 1 | fp16: 0 | warp size: 64 | matrix cores: none
whisper_init_with_params_no_state: devices    = 2
whisper_init_with_params_no_state: backends   = 2
whisper_model_load: loading model
whisper_model_load: n_vocab       = 51865
whisper_model_load: n_audio_ctx   = 1500
whisper_model_load: n_audio_state = 1024
whisper_model_load: n_audio_head  = 16
whisper_model_load: n_audio_layer = 24
whisper_model_load: n_text_ctx    = 448
whisper_model_load: n_text_state  = 1024
whisper_model_load: n_text_head   = 16
whisper_model_load: n_text_layer  = 24
whisper_model_load: n_mels        = 80
whisper_model_load: ftype         = 1
whisper_model_load: qntvr         = 0
whisper_model_load: type          = 4 (medium)
whisper_model_load: adding 1608 extra tokens
whisper_model_load: n_langs       = 99
whisper_default_buffer_type: using device Vulkan0 (Adreno (TM) 640)
ggml_vulkan: device Vulkan0 does not support 16-bit storage.
libc++abi: terminating due to uncaught exception of type std::runtime_error: Unsupported device
Aborted

Jluanka avatar Jan 27 '25 05:01 Jluanka