netron icon indicating copy to clipboard operation
netron copied to clipboard
verified publisher icon lutzroeder

GGUF support

Open lutzroeder opened this issue 2 years ago • 2 comments

Tasks:

  • [ ] Quantization
  • [ ] Architecture generation

Source: gguf_init_from_file

Examples: gpt-oss-20b-MXFP4.gguf.zip mixtral-8x7b-v0.1.Q4_K_M.gguf.zip phi-2.Q2_K.gguf.zip vicuna-33b.Q2_K.gguf.zip

lutzroeder avatar Dec 31 '23 20:12 lutzroeder

I met this project now, how is this PR? I am still in the process of understanding everything

charmandercha avatar Jan 23 '25 15:01 charmandercha

@charmandercha It shows the blocks themselves, but not their relationships, their outputs, or how they feed into one another.

NoahBPeterson avatar Feb 23 '25 21:02 NoahBPeterson