Fabian Peña

Hi, I am developing a brief interface where user can select if compute t-SNE at once or observe the iterations. Unfortunately, I am not able to obtain comparable results using...

Error with tf-keras when trying to geneate random seeds

1

### System Info I am repeatedly having this error when I try to instantiate the BERT model for pre-training using TensorFlow: ``` File c:\Users\Fabian Pena\.conda\envs\senlp-tf\Lib\site-packages\tf_keras\src\backend.py:2032, in RandomGenerator._create_seed(self, user_specified_seed) [2030](file:///C:/Users/Fabian%20Pena/.conda/envs/senlp-tf/Lib/site-packages/tf_keras/src/backend.py:2030) return...

Error pre-training BERT

1

Hi guys, I am following the Megatron-LM example to pre-train a BERT model but I'm getting this error: ``` [rank0]: Traceback (most recent call last): [rank0]: File "/root/Megatron-LM/pretrain_bert.py", line 193,...

[BUG] Error pre-training BERT

2

Hi guys, I am following the Megatron-LM example to pre-train a BERT model but I'm getting this error: ``` [rank0]: Traceback (most recent call last): [rank0]: File "/root/Megatron-LM/pretrain_bert.py", line 193,...

Hi guys, I want to evaluate models like ModernBERT, Llama and many others on SuperGLUE and my own benchmark. In my setting, every model has to be fine-tuned for the...

Hi. I just deployed locally the template and I'm getting this error: ``` Hydration failed because the server rendered HTML didn't match the client. As a result this tree will...

Hi guys, How can I implement a pipeline to check for contamination between two different datasets (e.g., pre-training vs. fine-tuning datasets) and eventually delete marked documents from the pre-training dataset?...

Evaluation of encoder and decoder models on SuperGLUE

3

Hi guys, I want to evaluate models like ModernBERT, Llama and many others on SuperGLUE and my own benchmark. In my setting, every model has to be fine-tuned for the...