transformer-utils

transformer-utils copied to clipboard

Plot top k most-probable logits in logit lens

1

I'd like to see not just the single absolute probable token, but the top k most probable tokens.

nathanneuro

{ "name": "AttributeError", "message": "module 'transformers.file_utils' has no attribute 'hf_bucket_url'", "stack": "--------------------------------------------------------------------------- AttributeError Traceback (most recent call last) Cell In[8], line 8 5 enable_low_memory_load() 7 tok = transformers.AutoTokenizer.from_pretrained(\"gpt2\") ----> 8...

imessien

timothee-chauvin

scipy is used in logit_lens/plotting.py

timothee-chauvin

This is not necessary but would fix one of my pipelines

neverix