PUSHKAR RAJ comments

Repositories
Issues
Comments

Results 4 comments of


                                            PUSHKAR RAJ

Warning: reader on shard 0 of the pipeline has been blocked more than 10.0s waiting for other readers to catch up. All pipeline shards must be read from concurrently.

This is my repo with latest updates : https://github.com/pushkarraj/LLMs_finetuning you might have to make a little changes in order to run on your cloud. I would love to get a...

AttributeError: 'BloomModel' object has no attribute 'n_head'

This is my repo : https://github.com/pushkarraj/LLMs_finetuning.git I have been using latest ludwig repo to fine tune series of bloom models. I am using the file cluster.yamal to build a GPU...

AttributeError: 'BloomModel' object has no attribute 'n_head'

yes it did, I used your pip released Ludwig version,that too failed on bloom-1b1. I did not test it with the current ludwig on the master branch.

How much memory do I need for trainning?

Hi, Can you share the training code and define the methodologies used?