Oleksandr Korovii

Add parametr ```return_dict=False``` into constructor ```SentimentClassifier``` it`s new changes in ```transformers``` ```self.bert = BertModel.from_pretrained(PRE_TRAINED_MODEL_NAME, return_dict=False)```

Replace the string ```self.bert = transformers.BertModel.from_pretrained('bert-base-cased')``` on ```self.bert = transformers.BertModel.from_pretrained('bert-base-cased', return_dict=False)``` About ```p=0.3``` it's a probability, for random disabling neurons during training. You should check what is the [dropout](https://en.wikipedia.org/wiki/Dilution_(neural_networks)) and...

@muellerzr can you give me the example how to use `accelerator.utils.gather` with `split_between_processes` context manager?

@muellerzr Thank you! Also, have additional question, can I use `tqdm` with `split_between_processes` to see the progress?

@muellerzr What I should pass into gather? Because I get the error: ```python TypeError: Unsupported types () passed to `_gpu_gather_one`. Only nested list/tuple/dicts of objects that are valid for `is_torch_tensor`...

@muellerzr thanks for your support. Here is my complete script, which also includes progress bar. It works on 4 GPUs. I think you can use this to improve documentation, or...

Is it possible to add FlashAttention2 to GPT2 models?

Here the described problem in more detail https://github.com/huggingface/optimum/issues/1758

Here is working implementation for OVModelForTokenClassification ```python from typing import Union, Optional from transformers.modeling_outputs import TokenClassifierOutput from optimum.intel.openvino.modeling import OVModel class OVModelForTokenClassification(OVModel): export_feature = "token-classification" auto_model_class = AutoModelForTokenClassification def __init__(self,...

I have the same error with exporting model `multilingual-e5-small` to onnx finetuned for token classification task Here the my trace: ``` --------------------------------------------------------------------------- ValueError Traceback (most recent call last) Cell In[5],...