SUNIL KUMAR SAHU

icon indicating an email [email protected]

icon location Abu Dhabi icon location Inception Institute of Artificial Intelligence Abu Dhabi

Results 4 issues of SUNIL KUMAR SAHU

All candidate pair scores?

4 comment

Hi I was trying to understand the code. I found that you are feeding an abstract separately for each candidate pair of the abstract in the model. However, in the...

Update LICENSE

Create LICENSE

Slow training on Mixtral-8x22B when DP size > 1

5 comment

**Describe the bug** We are in the process of fine-tuning Mixtral-8x22b using an instruction fine-tuning dataset. The model is divided using PP=8 and TP=4. Our experiments are conducted on DGX...

bug
stale