Lookback-Lens
Lookback-Lens copied to clipboard
There is no argument on LLM, Generate on ./transformers-4.32.0
I run python step01_extract_attns.py but it goes like below, then I check the ./transformers-4.32.0 on Lookback-Lens but I can't fine blow args... any idea what is the matter?
ValueError: The following model_kwargs are not used by the model: ['extrapolate_coeff', 'pre_softmax', 'divergence_type', 'relative_top', 'relative_top_with_norm', 'contrast_disagree_only', 'premature_temp', 'apply_early_norm'] (note: typos in the generate arguments will also show up in this list)