Bypassing 1024 max length in sample size

[aletote]

Is there a way to do it? If so, what is it?

In your notebook example to create gpt-2 from scratch there's a line: config = build_gpt2_config(vocab_size=5000, max_length=32, dropout=0.0, n_embd=256, n_layer=8, n_head=8)

Can I change max_length to 4096 for example?

[possibly-not]

This isn't a change to the max length but you can always use the prompt and put part of the previously generated text back into a new one. A bit clunky but might work okay.