PerroPastor
PerroPastor copied to clipboard
alvion427
Run Llama based LLMs in Unity entirely in compute shaders with no dependencies
Exception: Unknown magic number: 1734830708 GGUFLoader.LoadMetadata (System.String path) (at C:/Users/Evan/Downloads/PerroPastor-master/UnityPackage/Loaders/GGUFLoader.cs:96) GGUFLoader+c__DisplayClass10_0.b__5 () (at C:/Users/Evan/Downloads/PerroPastor-master/UnityPackage/Loaders/GGUFLoader.cs:240) System.Threading.Tasks.Task`1[TResult].InnerInvoke () (at :0) System.Threading.Tasks.Task.Execute () (at :0) --- End of stack trace from previous location...
not sure where to post this but is there a way to change the context or seq output length? it looks like its maxed out at 512 tokens but the...
KeyNotFoundException: The given key 'Q6_K' was not present in the dictionary. System.Collections.Generic.Dictionary`2[TKey,TValue].get_Item (TKey key) (at :0) GGMLTraitTypeExtensions.GetTraits (GGMLType type) (at D:/01_Unity/2023-09-29_PerroPastor-master/UnityPackage/Loaders/GGMLTypes.cs:189) GGMLLoader.CalculateTensorSize (TensorMeta tensor) (at D:/01_Unity/2023-09-29_PerroPastor-master/UnityPackage/Loaders/GGMLLoader.cs:341) GGMLLoader.ReadTensorMetadata (System.IO.BinaryReader reader, GGMLFileVersion...
Gaming cards I've tested on (RTX 3050, RTX 3070) are willing to read RWStructuredBuffer from buffers of vectors, but it appears that some cards (the only one I've tested on...
