llama_generate_text: error: unable to load model

[sandorex]

I downloaded the CPU version of the addon and followed the example with models GRMR-1B-Instruct and SmolLM2-1.7B-Instruct and it keeps giving me vague error of being unable to load the model

I do not have a discrete GPU and i do not wish to use the GPU at all as this model seems quite fast even using the CPU

Full log with verbose output

Godot Engine v4.4.stable.official.4c311cbee - https://godotengine.org
TextServer: Added interface "Dummy"
TextServer: Added interface "ICU / HarfBuzz / Graphite (Built-in)"
JoypadLinux: udev enabled and loaded successfully.
Xshape 1.1 detected.
Xinerama 1.1 detected.
Xrandr 1.6 detected.
Xrender 0.11 detected.
Xinput 2.2 detected.
XInput: Refreshing devices.
XInput: Absolute pointing device: xwayland-pointer:10
XInput: No touch devices found.
Devices:
  #0: AMD AMD Radeon Graphics (RADV RENOIR) - Supported, Integrated
  #1: Unknown llvmpipe (LLVM 19.1.7, 256 bits) - Supported, CPU
Optional extension VK_KHR_fragment_shading_rate not found
Optional extension VK_EXT_astc_decode_mode not found
Optional extension VK_EXT_debug_marker not found
- Vulkan Variable Rate Shading not supported
- Vulkan multiview supported:
  max view count: 8
  max instances: 2147483647
- Vulkan subgroup:
  size: 64
  min size: 64
  max size: 64
  stages: STAGE_VERTEX, STAGE_TESSELLATION_CONTROL, STAGE_TESSELLATION_EVALUATION, STAGE_GEOMETRY, STAGE_FRAGMENT, STAGE_COMPUTE
  supported ops: FEATURE_BASIC, FEATURE_VOTE, FEATURE_ARITHMETIC, FEATURE_BALLOT, FEATURE_SHUFFLE, FEATURE_SHUFFLE_RELATIVE, FEATURE_CLUSTERED, FEATURE_QUAD
  quad operations in all stages
Vulkan 1.4.305 - Forward Mobile - Using Device #0: AMD - AMD Radeon Graphics (RADV RENOIR)
Startup PSO cache (0.0 MiB)
ScreenSaver: DBus 1.14.10 detected.
FreeDesktopScreenSaver: Acquired screensaver inhibition cookie: 8029
PortalDesktop: DBus 1.14.10 detected.
Using "default" pen tablet driver...
Creating VMA small objects pool for memory type index 0
Shader 'CanvasSdfShaderRD' (group 0) SHA256: 9017588a260dde85a15ceef0f2050d27677567e52504c16499dcdab8baac6646
Shader 'SkeletonShaderRD' (group 0) SHA256: da8dc822e443fbfd35081e8df308f21b36632e265d24c0ff018c23944d4a4ed5
Shader 'SortShaderRD' (group 0) SHA256: 57877473058397e31f757bc30eb948b89842f368b07159d5d98a0840f1b10e7c
Shader 'ParticlesShaderRD' (group 0) SHA256: c02235b58a687d351847baa09af80db6e0b581c5d0beffa5e85d761d7ca255c3
Shader 'ParticlesCopyShaderRD' (group 0) SHA256: 8e6b4d21331b6c74954dfac06d35e730ecf57ae93bf75bbf18762ef2a75b143f
Shader 'CanvasShaderRD' (group 0) SHA256: ffda76217e4e495fe8b067e42393413020903607ef10f736bffd0e85478a1cd6
Shader 'CanvasOcclusionShaderRD' (group 0) SHA256: 78d0dad367da46f8e4d1d005abe201102a3131758d09884cc97d281bf514ae14
Shader 'SceneForwardMobileShaderRD' (group 0) SHA256: 3eade05fbe277ebe8c1eafb51237536fdd71c6d121ac7e07ccbb3fb547283abb
Shader 'SkyShaderRD' (group 0) SHA256: 38d3d2c98f9ebb4393552afe27bfe600b930e0bd83c32666b69c049571822abb
Shader 'BokehDofRasterShaderRD' (group 0) SHA256: b1c64e9e93ccc27215209570ed5a579fc8bdf5cb9a27bfdd93bacc06007995af
Shader 'BlurRasterShaderRD' (group 0) SHA256: 1d5423f6460d58ccc456a2351022c64f8a2683e8a20c92bf0c055000cc757d57
Shader 'CopyShaderRD' (group 0) SHA256: cc668e515c34a535d460ce484d715b99d9e762131571fb421f06d62f7e32192a
Shader 'CopyToFbShaderRD' (group 0) SHA256: 27ea6bf1012a8b5d5bfb7e235f87708a7197103d8e96f09d8038331b4d83b7d5
Shader 'CubeToDpShaderRD' (group 0) SHA256: a904b0efa521c405a048bcc71acc6806f5003502bedbd81b555b50acfa66a78b
Shader 'CubemapDownsamplerRasterShaderRD' (group 0) SHA256: e7f2d055d090edb6043ee88e2b13bce0cd009fdb9374e647748fcc6c3e386831
Shader 'CubemapFilterRasterShaderRD' (group 0) SHA256: 39113bc4e55288a0292341d1a293c0075cd8497d09f59c548e5755d7cb8e5296
Shader 'CubemapRoughnessRasterShaderRD' (group 0) SHA256: 3bcf6bf3c81da88d2db2ad2403933a459aacd3722088f51717c1f0c3b5ea5cab
Shader 'SpecularMergeShaderRD' (group 0) SHA256: 6230f024e7ecbdf38d3a3ce9cb5322543ceeb7cf461d413ad9e27d77f8d2d159
Shader 'ShadowFrustumShaderRD' (group 0) SHA256: 0c8dd6d669ccd50adf52b13c9b688de014ade6372633f9f62667c3581e50d03e
Shader 'MotionVectorsShaderRD' (group 0) SHA256: 3a7e3f26a9cd6402ae0980c9afe64c418e601cede8c47534fbf252a3a72f4be9
Shader 'LuminanceReduceRasterShaderRD' (group 0) SHA256: 41ed602cc027b17fe2ebac3efd5cb6ab9d4818b1589e4314049617a3f5567740
Shader 'TonemapShaderRD' (group 0) SHA256: 632b4a48450c580a9448f2cafc880f0241297604a6e8efa69c6e11e94967209b
Shader 'BlitShaderRD' (group 0) SHA256: e28e885c05b8cf80eb3f307c4af64cc8b0d3dff33fe0e296172a30c2b0f98789
PulseAudio 17.0.0 detected.
PulseAudio: context other
PulseAudio: context other
PulseAudio: context other
PulseAudio: context ready
PulseAudio: Detecting channels for device: bluez_output.41_42_1A_8E_95_27.1
PulseAudio: detected 2 output channels
PulseAudio: audio buffer frames: 512 calculated output latency: 11ms

TextServer: Primary interface set to: "ICU / HarfBuzz / Graphite (Built-in)".
CORE API HASH: 3954330213
EDITOR API HASH: 1116905369
Loaded system CA certificates
Loading resource: res://test.tscn
Loading resource: res://test.gd
GDLlama constructor
Instantiate GDLlama mutex
Instantiate GDLlama thread
Instantiate GDLlama thread -- done
GDLlama constructor -- done
GDLlama _ready
GDLlama _ready -- done
generate_text_simple
generate_text_mutex locked
generate_text_simple_internal
generate_text_common start
generate_text_common start -- done
generate_text_mutex unlocked
generate_text_simple_internal -- done
generate_text_simple -- done
llama_generate_text: error: unable to load model
llama_generate_text: error: unable to load model
--- Debugging process stopped ---

Here is the code

extends Node2D

@onready var text_edit: TextEdit = $CanvasLayer/TextEdit
@onready var text_edit_2: TextEdit = $CanvasLayer/TextEdit2
@onready var gd_llama: GDLlama = $GDLlama

func _on_button_pressed() -> void:
	print(gd_llama.generate_text_simple("Hello"))