indonlg
indonlg copied to clipboard
IndoNLP
The first-ever vast natural language generation benchmark for Indonesian, Sundanese, and Javanese. We provide multiple downstream tasks, pre-trained IndoGPT and IndoBART models, and a starter code! (E...
Hi! I want to re-built the model for Question Answering, but when i want to save the model using .save_pretrained() using this code: tokenizer.save_pretrained('./model') And There was Error : NotImplementedError...
the tokenizer loader InodNLGTokenizer have issue with standart PreTrainedTokenizer class hugging face it will cause an error [/usr/local/lib/python3.12/dist-packages/transformers/tokenization_utils.py](https://localhost:8080/#) in _batch_prepare_for_model(self, batch_ids_pairs, add_special_tokens, padding_strategy, truncation_strategy, max_length, stride, pad_to_multiple_of, padding_side, return_tensors, return_token_type_ids,...
