llama2.c icon indicating copy to clipboard operation
llama2.c copied to clipboard

Published 20 hours ago • verified publisher icon karpathy

"Can I increase or decrease the size of individual model layers separately?"

Open win10ogod opened this issue 1 year ago • 2 comments

"Can I increase or decrease the size of individual model layers separately?"

win10ogod avatar Oct 10 '23 02:10 win10ogod

Not with the code as it is, but you can play with it (make the blocks depend on layer_id). The code is quite modular. Just be aware of the skip connection which forces some things regarding dimensions. There are workarounds for that too.

artnoage avatar Oct 23 '23 09:10 artnoage

不是按原樣使用程式碼，但您可以使用它（使區塊依賴layer_id）。該程式碼非常模組化。請注意跳過連接，它會強制執行一些有關尺寸的事情。也有解決方法。

how to achieve the setting?

win10ogod avatar Oct 23 '23 11:10 win10ogod