Ashvini Jindal

icon indicating an email [email protected]

icon location San Francisco, USA icon location Trying to learn :)

Results 4 comments of Ashvini Jindal

maybe this code can not predict arc labels

Hi @mmliang , apologies for the late response. Have you already made changes to existing code-base to predict arc_label as well. Few things that will change are data reading, the...

How to use

Hi @shihe123 , Apologies for the late response. Model will be saved under `data/params_*` Please have a look at method: `def compute_dependencies()`

What MFU score is to be expected?

Hi @yohan-pg , on 1x 4090 GPU, I am getting 29% MFU while training GPT-2 124M model. What is your GPU setup?

fine tuning the updated Phi-2 with flash-attn-2 produces very high loss > 2

I am also seeing similar issue where loss is trending downwards but quite unstable and it seems to learn very slowly. I am running full fine-tuning of latest Phi2 model...