godot-llm icon indicating copy to clipboard operation
godot-llm copied to clipboard

Model is not running on GPU

Open SkySlider opened this issue 1 year ago • 2 comments

Even though I'm using a gpu build, inference is running on cpu/ram. I tried to tinker with parameters, but with no luck.

Log:

Godot Engine v4.3.stable.mono.official.77dcf97d8 - https://godotengine.org
TextServer: Added interface "Dummy"
TextServer: Added interface "ICU / HarfBuzz / Graphite (Built-in)"
Devices:
  #0: NVIDIA NVIDIA GeForce RTX 3050 - Supported, Discrete
- Vulkan Variable Rate Shading supported:
  Pipeline fragment shading rate
  Primitive fragment shading rate
  Attachment fragment shading rate, min texel size: (16, 16), max texel size: (16, 16), max fragment size: (4, 4)
- Vulkan multiview supported:
  max view count: 32
  max instances: 134217727
- Vulkan subgroup:
  size: 32
  min size: 32
  max size: 32
  stages: STAGE_VERTEX, STAGE_TESSELLATION_CONTROL, STAGE_TESSELLATION_EVALUATION, STAGE_GEOMETRY, STAGE_FRAGMENT, STAGE_COMPUTE, STAGE_RAYGEN_KHR, STAGE_ANY_HIT_KHR, STAGE_CLOSEST_HIT_KHR, STAGE_MISS_KHR, STAGE_INTERSECTION_KHR, STAGE_CALLABLE_KHR, STAGE_TASK_NV, STAGE_MESH_NV
  supported ops: FEATURE_BASIC, FEATURE_VOTE, FEATURE_ARITHMETIC, FEATURE_BALLOT, FEATURE_SHUFFLE, FEATURE_SHUFFLE_RELATIVE, FEATURE_CLUSTERED, FEATURE_QUAD, FEATURE_PARTITIONED_NV
  quad operations in all stages
Vulkan 1.3.278 - Forward+ - Using Device #0: NVIDIA - NVIDIA GeForce RTX 3050
Startup PSO cache (3.5 MiB)
Using "winink" pen tablet driver...
Creating VMA small objects pool for memory type index 1
Shader 'CanvasSdfShaderRD' (group 0) SHA256: f65579ae334cdfb6901aee2527afd18ed626d1067a35c91f12fb632b45ce7f21
Shader 'SkeletonShaderRD' (group 0) SHA256: 4964fd59acf4406110ae7bca4b716f23ae52cc19864e21a8a35aee53e141e17e
Shader 'SortShaderRD' (group 0) SHA256: 0b1e36114ab5330dc340cc740b0b946ed2dbf43098119b8d29cfa0222da18b7a
Shader 'ParticlesShaderRD' (group 0) SHA256: 47fcf57848349fdf54197e5c1f64750a69c8d54787d3509ade4781c9faa31654
Shader 'ParticlesCopyShaderRD' (group 0) SHA256: 69566a7b0235d75ec40f504cd5555856aace22b5273899269166fde57287d26e
Shader 'CanvasShaderRD' (group 0) SHA256: 165f6964cfc63fea91c4221f04e7b8a54b5dc39d76b5a57aed5f99b20050b148
Shader 'CanvasOcclusionShaderRD' (group 0) SHA256: 42f2245b35206bcace1cda9e39e9282519e9967978ba6d5956472809525b1150
Shader 'ClusterRenderShaderRD' (group 0) SHA256: e138dfa55627ca222eda3daa0739d50014770edfb2a8fbab0fa51e2130af04e8
Shader 'ClusterStoreShaderRD' (group 0) SHA256: 44efe54fdfa0811178ad2a7a0207ebc98532c6ae316489503cdc7c5c843a564e
Shader 'ClusterDebugShaderRD' (group 0) SHA256: 2546937b6acfcec18164bde1022dd572463c5dc6a8dfb2db860e93b1f8cb6cf1
Shader 'SceneForwardClusteredShaderRD' (group 0) SHA256: 29edc2f36233c2e08b9662507bec9ae15ecd3ff18670dd6a9d9e3c22bb80d2b9
Shader 'SceneForwardClusteredShaderRD' (group 1) SHA256: ff6c4ae20e3f8b8dd34fcdb417869f52a4530caf5116e770d0297554ac18fc6f
Shader 'SceneForwardClusteredShaderRD' (group 2) SHA256: 6598af838acb7313ff626d40126e27c0f884aa1a40a7cf5a1dd2311b2b83f39f
Shader 'SceneForwardClusteredShaderRD' (group 3) SHA256: 8d5d67c6d3310219a88106e8336290f6e7be7d1cc12a536cef74b57ba697d3dd
Shader 'BestFitNormalShaderRD' (group 0) SHA256: da50b1ee325fa09e8a9d2278e44bfbc4e716c11aa4475ca5323315d9d3e84d70
Shader 'ResolveShaderRD' (group 0) SHA256: 4eed9a584e94b3db5e08b3dd178112267127e5cb55e97790e3791fff9eb617f7
Shader 'TaaResolveShaderRD' (group 0) SHA256: 66482a84ae3398a2cbd07e92185df239a902d24d388424e0dff9fe998af3c0b4
Shader 'Fsr2DepthClipPassShaderRD' (group 0) SHA256: f3a7731ebdc135b5cd0910085daa9440b9adba2dccae0797e528638f485437ca
Shader 'Fsr2ReconstructPreviousDepthPassShaderRD' (group 0) SHA256: b56b046186e0886ebe0df89f96476a1b6cdd80243d937b9fa3808f57e20326ae
Shader 'Fsr2LockPassShaderRD' (group 0) SHA256: fd7270679041c16c1c160152344dc333e0d4d01a9ea61f5ab1a97a4f148ae642
Shader 'Fsr2AccumulatePassShaderRD' (group 0) SHA256: 160fedb5d3ef5cf63f06d76d8bf08e8739978139204922b5f9e4d50a873eef55
Shader 'Fsr2RcasPassShaderRD' (group 0) SHA256: 1c81d789b4d2bd0f51f75c03bdd7834fc8ce0050500ea90e2fb5b4973a5c507e
Shader 'Fsr2ComputeLuminancePyramidPassShaderRD' (group 0) SHA256: 91b43885fedcca5ed604c06712cb9ebd6b2e3d2df8e9185e01069bdabda408ab
Shader 'Fsr2AutogenReactivePassShaderRD' (group 0) SHA256: dd661f6230e50b82cb23ca149e6f15401a0151912d074fd0bad085910647aeaa
Shader 'Fsr2TcrAutogenPassShaderRD' (group 0) SHA256: 51c41e3962f077bfbb9a7b6dd127c0d38925ace2350a44c93a1cf5e7bb7d9a13
Shader 'SsEffectsDownsampleShaderRD' (group 0) SHA256: d85ba7758123b2364d96690db4594bb43feabce176805e46abc91aa54c5874d4
Shader 'SsilShaderRD' (group 0) SHA256: 20c3a95a7a0528ebb5844939feeb8fe446ac0dcde9d011e24c2fc54af67e6c6d
Shader 'SsilImportanceMapShaderRD' (group 0) SHA256: abbec59f40ae844d9bbca6d058972ef757a0baf48cdf91ef5836a8960f11569e
Shader 'SsilBlurShaderRD' (group 0) SHA256: dc4c027d65e080b2b5b1af257e3733c6bc35899ce02c3f333249db264836bd41
Shader 'SsilInterleaveShaderRD' (group 0) SHA256: 76868dec9e116ecbddcf9a480d808d2509e42cf65d5f7182e4f4cad2e24c9c70
Shader 'SsaoShaderRD' (group 0) SHA256: 10348af53d51e568e9a1574f4be3c4bc66eb9b2b464c8e4f061d051e1a6c4de9
Shader 'SsaoImportanceMapShaderRD' (group 0) SHA256: 6d680b1500cda48a2de67225a98a208373d657c0f128c9e34a1528b50b3c2c5b
Shader 'SsaoBlurShaderRD' (group 0) SHA256: 32baf23e3ccb90d5c6840258a705d953d950a779d125df3b5bb979bd1309f4d4
Shader 'SsaoInterleaveShaderRD' (group 0) SHA256: d3d5b300acaef6d08dcd3d033f393c424ad653c5ab554883703c29ee6eedf528
Shader 'ScreenSpaceReflectionScaleShaderRD' (group 0) SHA256: e5b92b2248f95dfc9534e9d5ec71a9d1fedfe58dd8fbbb2e903d8606c1ed8e0c
Shader 'ScreenSpaceReflectionShaderRD' (group 0) SHA256: 722d4571bebbe24c59b13360d89825ac27099da739a27f42e20a004e5e92da73
Shader 'ScreenSpaceReflectionFilterShaderRD' (group 0) SHA256: dbd56507c7ba6e4548ad94d4267e97184ea703036185204db88001c82b622120
Shader 'SubsurfaceScatteringShaderRD' (group 0) SHA256: 43df2517be4d76d26d345b88762bb6d272983e54f79d503331a085ec082a97da
Shader 'SkyShaderRD' (group 0) SHA256: 4bc541bfde1c30032df77bb4c98974909ad0368d22557f44e6cf095b26c0490a
Shader 'VoxelGiShaderRD' (group 0) SHA256: 8bfb40cf41510d02f432927249e4d6d6708843a0953b4faf61a2f2e3786d4fd0
Shader 'VoxelGiDebugShaderRD' (group 0) SHA256: 83ec08f78c119345f086a6cbcb0da5d67f664d19fd7ba3259c4948638b76fb8c
Shader 'SdfgiPreprocessShaderRD' (group 0) SHA256: 42b3acb8f8f580e0ad8624239eada43680eb33d7a90e0279cf34b99bad80ffc9
Shader 'SdfgiDirectLightShaderRD' (group 0) SHA256: 803c48e266e0d9c1590d25424071a668b88abc76bcda6fdde74b8524f298683c
Shader 'SdfgiIntegrateShaderRD' (group 0) SHA256: 4647045d5ae8023ab209178c191d003ce94a58384c2bf158dfd5d1b256a1feb2
Shader 'GiShaderRD' (group 0) SHA256: 2b51ba5b3e4e6be7fc223f7517a8a8b80c61234f3fbd4ffa229da05d747f020a
Shader 'SdfgiDebugShaderRD' (group 0) SHA256: 372719c6eef32a8635d4db9b69f2f8b01b907642dbac0cc26f37ea2a76eeb95d
Shader 'SdfgiDebugProbesShaderRD' (group 0) SHA256: 41af92f24cfffd1d870ed50e96e7ae1bfd6c2cc11f728d520ef0a827972a1438
Shader 'VolumetricFogShaderRD' (group 0) SHA256: 22de546a38a6b3caaa1d02360e0e62d85133e560e5667f2f3f5e34e3145679af
Shader 'VolumetricFogProcessShaderRD' (group 0) SHA256: 2c2d7b3b51e66f06069290afb842fc1ee9ee4f60f06a5168b0cee5bd380366bc
Shader 'BokehDofShaderRD' (group 0) SHA256: 39f32133b5111c9c24ab7cd9b202ca96bb3aeb73e0c73ebd7b7a5dae08cb759f
Shader 'CopyShaderRD' (group 0) SHA256: 4a43f34799f84bc5a387aff816d36330149d91299172af9be2d3ab05cc0c4e9d
Shader 'CopyToFbShaderRD' (group 0) SHA256: 8668028c5ceed89276611359329de4a0f5d40702546caecc31456f63f6f9ffe8
Shader 'CubeToDpShaderRD' (group 0) SHA256: e3db5adc31b15e80112f4d7497dc8563c39b7d64675a53dcce7f9511c5ca9f80
Shader 'CubemapDownsamplerShaderRD' (group 0) SHA256: 6376d8aae8d25aa5fed14d9e78a76a69c5566f021773d2b38defa77a573b20f1
Shader 'CubemapFilterShaderRD' (group 0) SHA256: 96fd6d20ed52761601cf4665fa909c5a27f13aeaa25940cf720f4e331158ef8e
Shader 'CubemapRoughnessShaderRD' (group 0) SHA256: 1d72ea29a087908b2262137858ecb047ac60acf75d2e625661f01be4ce0d3ce2
Shader 'SpecularMergeShaderRD' (group 0) SHA256: a119881bb41d0ec2f36a7f060866ec38b88afa6d0e484a431c65b35b5a2e820b
Shader 'ShadowFrustumShaderRD' (group 0) SHA256: c9c1b6421f8f6625effc9ddfa4bb2c09cafda0942b62fb8e1414e90820e18fa0
Shader 'MotionVectorsShaderRD' (group 0) SHA256: cbf3cbdcba0d0a2026c9fbf248556f1acd11beacc38a2e8c5ce7009ee49a1560
Shader 'LuminanceReduceShaderRD' (group 0) SHA256: 2687da76c0ac04fe197e7093fd065958200b5a2e8e378e0f61c445212a1a0ac4
Shader 'TonemapShaderRD' (group 0) SHA256: 1c4748b3de350503048a1f9eca4f1dc2b308086460692ea0a81bababfd80542a
Shader 'VrsShaderRD' (group 0) SHA256: def705023965d273a669c1ac6acfd7494138bde25b3e3bde0969c3c7a32c3aae
Shader 'FsrUpscaleShaderRD' (group 0) SHA256: 362fc0b19d06cf68dc6f6f2d99e1f9ccfd8afaef2a65e38a931df5dd9e183d7d
Shader 'BlitShaderRD' (group 0) SHA256: 09b63e5347ccb6779fd79e54b093cfc915ec80510efa1f613c9ada9ff2e0f70d
WASAPI: Activated output_device using IAudioClient3 interface
WASAPI: wFormatTag = 65534
WASAPI: nChannels = 2
WASAPI: nSamplesPerSec = 48000
WASAPI: nAvgBytesPerSec = 384000
WASAPI: nBlockAlign = 8
WASAPI: wBitsPerSample = 32
WASAPI: cbSize = 22
WASAPI: mix_rate = 48000
WASAPI: fundamental_period_frames = 480
WASAPI: min_period_frames = 480
WASAPI: max_period_frames = 480
WASAPI: selected a period frame size of 480
WASAPI: detected 2 channels
WASAPI: audio buffer frames: 480 calculated latency: 10ms

Using present mode: Enabled
TextServer: Primary interface set to: "ICU / HarfBuzz / Graphite (Built-in)".
.NET: Initializing module...
Found hostfxr: C:\Program Files\dotnet\host/fxr/8.0.8/hostfxr.dll
.NET: hostfxr initialized
.NET: GodotPlugins initialized
CORE API HASH: 4070621931
EDITOR API HASH: 591096730
Loaded system CA certificates
GDLlama constructor
Instantiate GDLlama mutex
Instantiate GDLlama thread
Instantiate GDLlama thread -- done
GDLlama constructor -- done
run_generate_text
generate_text_mutex locked
generate_text_thread instantiated
run_generate_text -- done
GDLlama _ready
GDLlama _ready -- done
generate_text_simple_internal
generate_text_common start
<|begin_of_text|>
(text tokens generating here)

SkySlider avatar Oct 01 '24 13:10 SkySlider