Tutorial on implementaion of ggml?

[nile649]

Hi georgi, I am sure this is not the right platform to make an unreasonable request. Could you make a tutorial or docs how did you went on implementing ggml and especially the design. I am personally lacking this skill.

Thank you

[ggerganov]

Hi! Glad to hear there is interest in this.

Will definitely write something on the topic. Most likely will focus on the various optimisations that I have used -- the machine learning concepts are already described in details elsewhere.

Let me know if there is something of specific interest for you.

[nile649]

I believe there is no need to include ML/DL, mostly about topics like design, design preference. Most of us are knowledgeable about ML, C, C++ but the rest what you did is magic to us.

I really appreciate the work you did. Thank you

[ekorudi]

I think simply take photograph of your design on paper for ggml will be helpful. I also try to understand main code using cflow and dot.

Here is easier form to read on paper https://docs.google.com/document/d/1SsRzqdpGt59Pl-KfFd3gwYZ__hnRWVft_ddITr1P0_g

Please share any other tools to make reading/undertanding code faster

[jaytxrx]

I am also interested in understanding the ggml file format. Could you please document that ? Curious to know why a new file format was created.