Eric Buehler

@matthewhaynesonline this is interesting! > What do you think of the general concept? I think it's a great concept! > Assuming you're okay with the general concept, do you have...

> Maybe I can take a pass implementing it fully / merge ready so you can see it in totality? E.g. cleaned up, builder pattern, server implementing server-core lib, benchmarks,...

@greenrazer we don't support the bf16 matmul for CPU at the moment. That might be why the `falcon` example doesn't work here, you should use f16 (or worst case, f32)...