LiXin

add gpt2 based llama2

1

基于libai gpt2实现的llama2

Bert中的Embedding Layer

1

您好，Bert当中的Embedding Layer是在Layer0之前的，他的学习率设置为Layer0乘以权重ξ（0.95）会不会更好一点？

index.py ```python import finetuner finetuner.login() # At this point, the browser will automatically open and log in to display the following page ```  After this screen appeared, there was...

libgomp: Thread creation failed: Resource temporarily unavailable

1

#### What is your question? 使用多次调用同一个模型报错，首次调用generate并不会报错，后2次或者3次就会报错 ``` libgomp: Thread creation failed: Resource temporarily unavailable libgomp: libgomp: libgomp: Thread creation failed: Resource temporarily unavailableThread creation failed: Resource temporarily unavailableThread creation failed:...