turkish-bert
turkish-bert copied to clipboard
Turkish BERT/DistilBERT, ELECTRA and ConvBERT models
Hello Stefan, I would like to ask if the exact training data for training Turkish Bert can be released? We would like to do some analysis of BERTs in different...
Getting the following error when converting my ckpt to huggingface's pytorch. I am using the same config file I used for the pretraining. ``` Traceback (most recent call last): File...
Hi! @stefan-it i need to bert-base-32k-uncased tf chekpoints for further pre-training on Cloud TPU. I found cased version from this link > wget https://schweter.eu/cloud/bert-base-turkish-cased/bert-base-turkish-cased-tf.tar.gz is it possible to get 32k...
Hello Stefan, I'm going to train another BERT model with different pre-training object from scratch. Then I will use it to compare with BERTurk and other Turkish pre-trained language models....
Hi guys, impressive result with ConvBERT, there is any cheatsheet of how to train from scratch? Your BERT and ELECTRA cheatsheets are very helpful.
Hey, I tried to train [DistilBERTurk](https://huggingface.co/dbmdz/distilbert-base-turkish-cased) model for question answering by using [run_squad.py](https://github.com/huggingface/transformers/blob/master/examples/legacy/question-answering/run_squad.py) script. After training, I got the error during evaluation stage; ``` Traceback (most recent call last): File...
Hi Stefan, I have a problem to get the all hidden layer's output of BERTurk. I tried as follows: model = AutoModel.from_pretrained("dbmdz/bert-base-turkish-uncased") Convert inputs (length 20) to PyTorch tensors tokens_tensor...
It seems huggingface repository contains only the base model, I couldn't find the model and tokenizer related to the model for named entity recognition. Where can I find the trained...
I want to combine this model with a CNN in tensorflow or tensorflow.keras but couldn't handle how to use these checkpoint files. Can someone help me about how to use...
Firstly thanks for this project but please could you please prepare a wiki page how to use this project, Thanks a lot