codebook-features icon indicating copy to clipboard operation
codebook-features copied to clipboard

Published 20 hours ago • verified publisher icon taufeeque9

Unfreeze transformer_lens version

Open taufeeque9 opened this issue 2 years ago • 0 comments

The rotary embedding issue is transformer_lens breaks the TinyStories codebook models. The issue was introduced in version 1.8.0 and so we have frozen transformer_lens' version at 1.7.0. Bump the version and update the mod_model_classes.py file once the issue gets resolved.

taufeeque9 avatar Oct 30 '23 05:10 taufeeque9