minGPT

minGPT copied to clipboard

Cs674

1

Westen-M

What's the max output tokens this model supports?

1

aletote

Should -1 marker (as special token) be counted in vocab_size?

1

https://github.com/karpathy/minGPT/blob/37baab71b9abea1b76ab957409a1cc2fbfba8a26/projects/adder/adder.py#L118 https://github.com/karpathy/minGPT/blob/37baab71b9abea1b76ab957409a1cc2fbfba8a26/projects/adder/adder.py#L89

mw66

Adds a three-line method which uses namedtuple to create frozen configs if one wants to avoid footguns. Checks off the 'todo' item in config. Elements of the config are still...

JosephCatrambone

Question: does it support other utf-8 natual language?

1

For example, chinese or japanese?

yingshaoxo

How can I run a trained model and can't run Test_ Hugging face_ Import. py

1

How can I run a trained model? Include/ Projects/add/model. pt. Test_ Hugging face_ Import. py directly runs this test program and reports File ".\minGPT\master\mingpt model. py", line 202, in from_...

linlong1314

Output of CausalSelfAttention

1

It seems that the output of this block is simply reshaped from multiple heads. From the original "Attention is all you need" paper, it seems that there is another linear...

whchan05

Generator repl enables interaction with adder model checkpoint.

prasad83

Issue:Renaming transformer.h into transformer.l #94 Url: https://github.com/karpathy/minGPT/issues/94 Fix: Renaming transformer.h into transformer.l in line 270 of model.py file and added comments

rjarun8

About layer norm dimention parameter:

1

In model.py, the implementation of layer norm is : self.ln_1 = nn.LayerNorm(config.n_embd) If batch_size = 64, block_size = 6, embedding_size = 48, then the shape of input is [64, 6,...

vcvycy