qlora-chinese-LLM icon indicating copy to clipboard operation
qlora-chinese-LLM copied to clipboard

Published 20 hours ago • verified publisher icon taishan1994

trainable参数量占比是多少

Open TIANRENK opened this issue 1 year ago • 0 comments

我训练的时候占比高达0.86，target_modules为'dense', 'dense_4h_to_h', 'dense_h_to_4h', 'query_key_value'

TIANRENK avatar Jun 13 '23 09:06 TIANRENK