Lookback-Lens icon indicating copy to clipboard operation
Lookback-Lens copied to clipboard

There is no argument on LLM, Generate on ./transformers-4.32.0

Open naknak-choi opened this issue 1 year ago • 1 comments

I run python step01_extract_attns.py but it goes like below, then I check the ./transformers-4.32.0 on Lookback-Lens but I can't fine blow args... any idea what is the matter?

ValueError: The following model_kwargs are not used by the model: ['extrapolate_coeff', 'pre_softmax', 'divergence_type', 'relative_top', 'relative_top_with_norm', 'contrast_disagree_only', 'premature_temp', 'apply_early_norm'] (note: typos in the generate arguments will also show up in this list)

naknak-choi avatar Aug 13 '24 06:08 naknak-choi