ipex-llm icon indicating copy to clipboard operation
ipex-llm copied to clipboard

Published 20 hours ago • verified publisher icon intel-analytics

Fix low memory generation example issue in transformers 4.36

Open jenniew opened this issue 10 months ago • 0 comments

Fix low memory generation example issue in transformers 4.36. Related issue: https://github.com/analytics-zoo/nano/issues/1157 Can support all transformers versions of 4.31+. Test it under transformers 4.31 and 4.36.

jenniew avatar Apr 09 '24 02:04 jenniew