torchscale icon indicating copy to clipboard operation
torchscale copied to clipboard

testing very large attention windows

Open fredzannarbor opened this issue 1 year ago • 0 comments

This is kind of a simple-minded question, but what do I do if I want to see for myself that I can process a huge attention window using torchscale? Ideally, I'd simply like to be able to run a single script or function that shows that, yes, it works, say with summarization of a large corpus of books.

fredzannarbor avatar Jul 06 '23 03:07 fredzannarbor