Gagan Bhatia

Upgrade to Python 3.8

6

Hello, Can we update the requirements.txt to support python 3.8 because some of the new features are in new packages can help this project a lot.

## Language: En ## Model Link: On HFhub ## Comments: Need more training power

## Language: ge ## Model Link: ## Comments:

## Language: fr ## Model Link: TBA ## Comments: TBA

**Is your feature request related to a problem? Please describe.** Gpt j model to be created **Describe the solution you'd like** A clear and concise description of what you want...

#### Type of change - [x] 📚 Documentation Update - [ ] 🧪 Tests Cases - [ ] 🐞 Bug fix (non-breaking change which fixes an issue) - [ ]...

Unable to train a Vision Encoder Decoder Model

2

ValueError: The batch received was empty, your model won't be able to train on it. Double-check that your training dataset contains keys expected by the model: args,kwargs,label_ids,label.

**Pull request recommendations:** - [ ] Name your pull request _your-development-type/short-description_. Ex: _feature/support-tiff-files_ - [ ] Link to any relevant issue in the PR description. Ex: _Resolves [gh-12], adds tiff...

TRL orpo gives everything Nan

6

{'loss': 0.0, 'grad_norm': nan, 'learning_rate': 2.5000000000000002e-08, 'rewards/chosen': nan, 'rewards/rejected': nan, 'rewards/accuracies': 0.0, 'rewards/margins': nan, 'logps/rejected': nan, 'logps/chosen': nan, 'logits/rejected': -3.114448070526123, 'logits/chosen': -3.114448070526123, 'nll_loss': nan, 'log_odds_ratio': nan, 'log_odds_chosen': nan, 'epoch': 0.0}...

## Describe a requested feature - Add Vision Encoder Decoder model to parallelformers ## Expected behavior ```python >>> a = Foo() >>> a.predict() ```