Daniel Bevenius

This sounds interesting. Could some more details around this idea be provided?

Hope it is alright that I created this issue without any actual tasks. I'm not sure what needs to be done or how these shims are created but hopefully others...

I get the same using output using the alpaca model as well. Note sure if this helps but I can get this working with the Llama-2-7B-Chat-ggml model following the steps...