llama_cpp_dart icon indicating copy to clipboard operation
llama_cpp_dart copied to clipboard
verified publisher icon netdur

When running deep seek 1.5 model , app crash in flutter

Open sadaqatdev opened this issue 11 months ago • 4 comments

Launching lib\main.dart on Windows in debug mode... E:\project\flutter_application_1\windows\flutter\ephemeral.plugin_symlinks\llama_cpp_dart\src\llama.cpp\ggml\src\ggml.c(1955,26): warning C4267: 'initializing': conversion from 'size_t' to 'int32_t', possible loss of data [E:\project\flutter_application_1\build\windows\x64\plugins\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-base.vcxproj] E:\project\flutter_application_1\windows\flutter\ephemeral.plugin_symlinks\llama_cpp_dart\src\llama.cpp\ggml\src\ggml.c(1955,31): warning C4267: 'initializing': conversion from 'size_t' to 'int32_t', possible loss of data [E:\project\flutter_application_1\build\windows\x64\plugins\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-base.vcxproj] E:\project\flutter_application_1\windows\flutter\ephemeral.plugin_symlinks\llama_cpp_dart\src\llama.cpp\ggml\src\ggml.c(1955,36): warning C4267: 'initializing': conversion from 'size_t' to 'int32_t', possible loss of data [E:\project\flutter_application_1\build\windows\x64\plugins\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-base.vcxproj] E:\project\flutter_application_1\windows\flutter\ephemeral.plugin_symlinks\llama_cpp_dart\src\llama.cpp\ggml\src\ggml.c(1955,41): warning C4267: 'initializing': conversion from 'size_t' to 'int32_t', possible loss of data [E:\project\flutter_application_1\build\windows\x64\plugins\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-base.vcxproj] E:\project\flutter_application_1\windows\flutter\ephemeral.plugin_symlinks\llama_cpp_dart\src\llama.cpp\ggml\src\ggml.c(2839,26): warning C4267: 'initializing': conversion from 'size_t' to 'int32_t', possible loss of data [E:\project\flutter_application_1\build\windows\x64\plugins\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-base.vcxproj] E:\project\flutter_application_1\windows\flutter\ephemeral.plugin_symlinks\llama_cpp_dart\src\llama.cpp\ggml\src\ggml.c(2839,31): warning C4267: 'initializing': conversion from 'size_t' to 'int32_t', possible loss of data [E:\project\flutter_application_1\build\windows\x64\plugins\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-base.vcxproj] E:\project\flutter_application_1\windows\flutter\ephemeral.plugin_symlinks\llama_cpp_dart\src\llama.cpp\ggml\src\ggml.c(2839,36): warning C4267: 'initializing': conversion from 'size_t' to 'int32_t', possible loss of data [E:\project\flutter_application_1\build\windows\x64\plugins\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-base.vcxproj] E:\project\flutter_application_1\windows\flutter\ephemeral.plugin_symlinks\llama_cpp_dart\src\llama.cpp\ggml\src\ggml.c(2839,41): warning C4267: 'initializing': conversion from 'size_t' to 'int32_t', possible loss of data [E:\project\flutter_application_1\build\windows\x64\plugins\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-base.vcxproj] E:\project\flutter_application_1\windows\flutter\ephemeral.plugin_symlinks\llama_cpp_dart\src\llama.cpp\ggml\src\ggml.c(3227,22): warning C4244: '=': conversion from 'int64_t' to 'int', possible loss of data [E:\project\flutter_application_1\build\windows\x64\plugins\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-base.vcxproj] E:\project\flutter_application_1\windows\flutter\ephemeral.plugin_symlinks\llama_cpp_dart\src\llama.cpp\ggml\src\ggml.c(3228,22): warning C4244: '=': conversion from 'int64_t' to 'int', possible loss of data [E:\project\flutter_application_1\build\windows\x64\plugins\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-base.vcxproj] E:\project\flutter_application_1\windows\flutter\ephemeral.plugin_symlinks\llama_cpp_dart\src\llama.cpp\ggml\src\ggml.c(3229,22): warning C4244: '=': conversion from 'int64_t' to 'int', possible loss of data [E:\project\flutter_application_1\build\windows\x64\plugins\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-base.vcxproj] E:\project\flutter_application_1\windows\flutter\ephemeral.plugin_symlinks\llama_cpp_dart\src\llama.cpp\ggml\src\ggml.c(3230,22): warning C4244: '=': conversion from 'int64_t' to 'int', possible loss of data [E:\project\flutter_application_1\build\windows\x64\plugins\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-base.vcxproj] E:\project\flutter_application_1\windows\flutter\ephemeral.plugin_symlinks\llama_cpp_dart\src\llama.cpp\ggml\src\ggml.c(3232,22): warning C4267: '=': conversion from 'size_t' to 'int', possible loss of data [E:\project\flutter_application_1\build\windows\x64\plugins\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-base.vcxproj] E:\project\flutter_application_1\windows\flutter\ephemeral.plugin_symlinks\llama_cpp_dart\src\llama.cpp\ggml\src\ggml.c(3233,22): warning C4267: '=': conversion from 'size_t' to 'int', possible loss of data [E:\project\flutter_application_1\build\windows\x64\plugins\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-base.vcxproj] E:\project\flutter_application_1\windows\flutter\ephemeral.plugin_symlinks\llama_cpp_dart\src\llama.cpp\ggml\src\ggml.c(3234,22): warning C4267: '=': conversion from 'size_t' to 'int', possible loss of data [E:\project\flutter_application_1\build\windows\x64\plugins\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-base.vcxproj] E:\project\flutter_application_1\windows\flutter\ephemeral.plugin_symlinks\llama_cpp_dart\src\llama.cpp\ggml\src\ggml.c(3235,22): warning C4267: '=': conversion from 'size_t' to 'int', possible loss of data [E:\project\flutter_application_1\build\windows\x64\plugins\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-base.vcxproj] E:\project\flutter_application_1\windows\flutter\ephemeral.plugin_symlinks\llama_cpp_dart\src\llama.cpp\ggml\src\ggml.c(3874,48): warning C4244: 'function': conversion from 'int64_t' to 'int', possible loss of data [E:\project\flutter_application_1\build\windows\x64\plugins\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-base.vcxproj] E:\project\flutter_application_1\windows\flutter\ephemeral.plugin_symlinks\llama_cpp_dart\src\llama.cpp\ggml\src\ggml.c(3906,52): warning C4244: 'function': conversion from 'int64_t' to 'int', possible loss of data [E:\project\flutter_application_1\build\windows\x64\plugins\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-base.vcxproj] E:\project\flutter_application_1\windows\flutter\ephemeral.plugin_symlinks\llama_cpp_dart\src\llama.cpp\ggml\src\ggml.c(3980,41): warning C4244: 'function': conversion from 'int64_t' to 'int', possible loss of data [E:\project\flutter_application_1\build\windows\x64\plugins\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-base.vcxproj] E:\project\flutter_application_1\windows\flutter\ephemeral.plugin_symlinks\llama_cpp_dart\src\llama.cpp\ggml\src\ggml.c(3980,51): warning C4244: 'function': conversion from 'int64_t' to 'int', possible loss of data [E:\project\flutter_application_1\build\windows\x64\plugins\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-base.vcxproj] E:\project\flutter_application_1\windows\flutter\ephemeral.plugin_symlinks\llama_cpp_dart\src\llama.cpp\ggml\src\ggml.c(3989,51): warning C4244: 'function': conversion from 'int64_t' to 'int', possible loss of data [E:\project\flutter_application_1\build\windows\x64\plugins\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-base.vcxproj] E:\project\flutter_application_1\windows\flutter\ephemeral.plugin_symlinks\llama_cpp_dart\src\llama.cpp\ggml\src\ggml.c(3989,65): warning C4244: 'function': conversion from 'int64_t' to 'int', possible loss of data [E:\project\flutter_application_1\build\windows\x64\plugins\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-base.vcxproj] E:\project\flutter_application_1\windows\flutter\ephemeral.plugin_symlinks\llama_cpp_dart\src\llama.cpp\ggml\src\ggml.c(4050,35): warning C4244: 'return': conversion from 'float' to 'int64_t', possible loss of data [E:\project\flutter_application_1\build\windows\x64\plugins\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-base.vcxproj] E:\project\flutter_application_1\windows\flutter\ephemeral.plugin_symlinks\llama_cpp_dart\src\llama.cpp\ggml\src\ggml.c(4063,54): warning C4244: 'function': conversion from 'int' to 'float', possible loss of data [E:\project\flutter_application_1\build\windows\x64\plugins\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-base.vcxproj] E:\project\flutter_application_1\windows\flutter\ephemeral.plugin_symlinks\llama_cpp_dart\src\llama.cpp\ggml\src\ggml.c(4100,46): warning C4244: 'initializing': conversion from 'float' to 'int32_t', possible loss of data [E:\project\flutter_application_1\build\windows\x64\plugins\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-base.vcxproj] E:\project\flutter_application_1\windows\flutter\ephemeral.plugin_symlinks\llama_cpp_dart\src\llama.cpp\ggml\src\ggml.c(4100,50): warning C4244: 'initializing': conversion from 'float' to 'int32_t', possible loss of data [E:\project\flutter_application_1\build\windows\x64\plugins\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-base.vcxproj] E:\project\flutter_application_1\windows\flutter\ephemeral.plugin_symlinks\llama_cpp_dart\src\llama.cpp\ggml\src\ggml.c(4123,46): warning C4244: 'initializing': conversion from 'float' to 'int32_t', possible loss of data [E:\project\flutter_application_1\build\windows\x64\plugins\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-base.vcxproj] E:\project\flutter_application_1\windows\flutter\ephemeral.plugin_symlinks\llama_cpp_dart\src\llama.cpp\ggml\src\ggml.c(4123,50): warning C4244: 'initializing': conversion from 'float' to 'int32_t', possible loss of data [E:\project\flutter_application_1\build\windows\x64\plugins\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-base.vcxproj] E:\project\flutter_application_1\windows\flutter\ephemeral.plugin_symlinks\llama_cpp_dart\src\llama.cpp\ggml\src\ggml.c(4159,47): warning C4244: 'function': conversion from 'int64_t' to 'int', possible loss of data [E:\project\flutter_application_1\build\windows\x64\plugins\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-base.vcxproj] E:\project\flutter_application_1\windows\flutter\ephemeral.plugin_symlinks\llama_cpp_dart\src\llama.cpp\ggml\src\ggml.c(4159,72): warning C4244: 'function': conversion from 'int64_t' to 'int', possible loss of data [E:\project\flutter_application_1\build\windows\x64\plugins\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-base.vcxproj] E:\project\flutter_application_1\windows\flutter\ephemeral.plugin_symlinks\llama_cpp_dart\src\llama.cpp\ggml\src\ggml.c(4159,93): warning C4244: 'function': conversion from 'int64_t' to 'int', possible loss of data [E:\project\flutter_application_1\build\windows\x64\plugins\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-base.vcxproj] E:\project\flutter_application_1\windows\flutter\ephemeral.plugin_symlinks\llama_cpp_dart\src\llama.cpp\ggml\src\ggml.c(4159,103): warning C4244: 'function': conversion from 'int64_t' to 'int', possible loss of data [E:\project\flutter_application_1\build\windows\x64\plugins\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-base.vcxproj] E:\project\flutter_application_1\windows\flutter\ephemeral.plugin_symlinks\llama_cpp_dart\src\llama.cpp\ggml\src\ggml.c(4530,36): warning C4244: 'initializing': conversion from 'int64_t' to 'const int', possible loss of data [E:\project\flutter_application_1\build\windows\x64\plugins\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-base.vcxproj] E:\project\flutter_application_1\windows\flutter\ephemeral.plugin_symlinks\llama_cpp_dart\src\llama.cpp\ggml\src\ggml.c(4531,36): warning C4244: 'initializing': conversion from 'int64_t' to 'const int', possible loss of data [E:\project\flutter_application_1\build\windows\x64\plugins\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-base.vcxproj] E:\project\flutter_application_1\windows\flutter\ephemeral.plugin_symlinks\llama_cpp_dart\src\llama.cpp\ggml\src\ggml.c(5667,108): warning C4244: 'function': conversion from 'const int32_t' to 'float', possible loss of data [E:\project\flutter_application_1\build\windows\x64\plugins\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-base.vcxproj] E:\project\flutter_application_1\windows\flutter\ephemeral.plugin_symlinks\llama_cpp_dart\src\llama.cpp\ggml\src\ggml.c(5667,112): warning C4244: 'function': conversion from 'const int32_t' to 'float', possible loss of data [E:\project\flutter_application_1\build\windows\x64\plugins\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-base.vcxproj] E:\project\flutter_application_1\windows\flutter\ephemeral.plugin_symlinks\llama_cpp_dart\src\llama.cpp\ggml\src\ggml.c(5945,29): warning C4267: 'initializing': conversion from 'size_t' to 'int', possible loss of data [E:\project\flutter_application_1\build\windows\x64\plugins\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-base.vcxproj] C:\Program Files (x86)\Windows Kits\10\Include\10.0.22621.0\ucrt\assert.h(21,9): warning C4005: 'static_assert': macro redefinition [E:\project\flutter_application_1\build\windows\x64\plugins\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-base.vcxproj] E:\project\flutter_application_1\windows\flutter\ephemeral.plugin_symlinks\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-opt.cpp(599,77): warning C4244: 'argument': conversion from 'int64_t' to 'float', possible loss of data [E:\project\flutter_application_1\build\windows\x64\plugins\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-base.vcxproj] E:\project\flutter_application_1\windows\flutter\ephemeral.plugin_symlinks\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-opt.cpp(600,77): warning C4244: 'argument': conversion from 'int64_t' to 'float', possible loss of data [E:\project\flutter_application_1\build\windows\x64\plugins\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-base.vcxproj] E:\project\flutter_application_1\windows\flutter\ephemeral.plugin_symlinks\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-opt.cpp(810,30): warning C4244: '=': conversion from 'const int64_t' to 'int32_t', possible loss of data [E:\project\flutter_application_1\build\windows\x64\plugins\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-base.vcxproj] E:\project\flutter_application_1\windows\flutter\ephemeral.plugin_symlinks\llama_cpp_dart\src\llama.cpp\ggml\src\gguf.cpp(457,48): warning C4244: 'initializing': conversion from 'int64_t' to 'int', possible loss of data [E:\project\flutter_application_1\build\windows\x64\plugins\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-base.vcxproj] E:\project\flutter_application_1\windows\flutter\ephemeral.plugin_symlinks\llama_cpp_dart\src\llama.cpp\ggml\src\gguf.cpp(457,33): warning C4244: 'initializing': conversion from 'int64_t' to 'const int', possible loss of data [E:\project\flutter_application_1\build\windows\x64\plugins\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-base.vcxproj] E:\project\flutter_application_1\windows\flutter\ephemeral.plugin_symlinks\llama_cpp_dart\src\llama.cpp\ggml\src\gguf.cpp(592,21): warning C4267: 'argument': conversion from 'size_t' to 'long', possible loss of data [E:\project\flutter_application_1\build\windows\x64\plugins\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-base.vcxproj] E:\project\flutter_application_1\windows\flutter\ephemeral.plugin_symlinks\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-cpu\ggml-cpu.cpp(286,17): error C2664: 'LSTATUS RegQueryValueExA(HKEY,LPCSTR,LPDWORD,LPDWORD,LPBYTE,LPDWORD)': cannot convert argument 2 from 'const wchar_t [20]' to 'LPCSTR' [E:\project\flutter_application_1\build\windows\x64\plugins\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-cpu.vcxproj] E:\project\flutter_application_1\windows\flutter\ephemeral.plugin_symlinks\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-cpu\ggml-cpu.cpp(293,21): error C2664: 'LSTATUS RegQueryValueExA(HKEY,LPCSTR,LPDWORD,LPDWORD,LPBYTE,LPDWORD)': cannot convert argument 2 from 'const wchar_t [20]' to 'LPCSTR' [E:\project\flutter_application_1\build\windows\x64\plugins\llama_cpp_dart\src\llama.cpp\ggml\src\ggml-cpu.vcxproj] Error: Build process failed.

Exited (1).

sadaqatdev avatar Feb 04 '25 06:02 sadaqatdev

i am running in android. if you can, plz take your model name in hf to me. i try it late @sadaqatdev

Chaos-woo avatar Feb 04 '25 10:02 Chaos-woo

@Chaos-woo you can find the model in this link

https://huggingface.co/bartowski/DeepSeek-R1-Distill-Qwen-1.5B-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Q6_K.gguf?download=true

Other Details https://github.com/fabiomatricardi/Deepseek-R1-qwen1.5B?tab=readme-ov-file

sadaqatdev avatar Feb 04 '25 11:02 sadaqatdev

I will be update in few minutes, I just test your deep seek model and it worked

netdur avatar Feb 16 '25 01:02 netdur

@Chaos-woo try again with last commit

netdur avatar Feb 17 '25 13:02 netdur