Robert Felker
Robert Felker
It passed over it, sorry it should have been added. Maybe it can be updated?
Easiest way is to have a benchmark. Does launching with main and basic parameters like seed and temperature produce a similar output? Robbie Le sam. 2 mars 2024 à 20:32,...
Well beliefs is magic ;) Launching simple.cpp and main.cpp get differents result because some parameters are extracted from gguf. Different architecture then act differently. It may be the same here....
I tried to setup some tests to find some potential hints of diffs but my setup now fail with ```-[MTLComputePipelineDescriptorInternal setComputeFunction:withType:]:722: failed assertion computeFunction must not be nil.'```