Jiang Mj comments

Repositories
Issues
Comments

Results 2 comments of


                                            Jiang Mj

esm c (esmc-300m-2024-12 or esmc-600m-2024-12): AttributeError: property 'cls_token' of 'EsmSequenceTokenizer' object has no setter.

> Hi, I also encountered the same problem. At that time, I lowered the ESM to version 3.1.4 but still couldn't solve it. This issue occurs when deploying the model...

Why does the embedding generated by ESMC have two more tokens than the sequence length?

> Hi 595, > > I believe the reason lies in the fact that ESM C was trained using a BERT-like transformer architecture. In BERT-like models, a beginning of sequence...