LongLM icon indicating copy to clipboard operation
LongLM copied to clipboard
verified publisher icon datamllab

Memory usage

Open scar-on opened this issue 1 year ago • 0 comments

Dear Author, hello. I have a question about the memory usage. I implemented the original torch on an V100×8, but when the inference length reaches 8k, the memory is insufficient. Could you share the related memory usage of self extend?

scar-on avatar Dec 13 '24 13:12 scar-on