fmikaelian

Hi @alex-movila You can follow our progress on this PR [here.](https://github.com/cdqa-suite/cdQA/pull/205#issue-298147002) We described all the steps to achieve in order to be synced with the latest changes made by @huggingface....

I could not replicate results of official SQuAD 2.0 with our trained XLNet model: ```python from cdqa.reader.reader_sklearn import Reader reader = Reader(model_type='xlnet', model_name_or_path='xlnet-base-cased', fp16=False, output_dir='.', no_cuda=False, pretrained_model_path='.') reader.evaluate(X='dev-v2.0.json') ``` See...

> I could not replicate results of official SQuAD 2.0 with our trained XLNet model: > > ```python > from cdqa.reader.reader_sklearn import Reader > > reader = Reader(model_type='xlnet', > model_name_or_path='xlnet-base-cased',...

@aqsa27 how does your csv look like? Can you share the format or a sample here?

Hi @alex-movila Thank you for recommending this implementation! Speed and scalability are indeed very important to use `cdQA` in production. At this stage, our primary focus is to make end-to-end...

I think if we can achieve #209 and make `cdQA` modular (having possibility to chose different retriever/reader impementations) hopefully everyone will be able to have a solution given his/her specific...

Hi @weinixuehao You can use cdQA in chinese, but it requires some additional work. The idea is to: - Find a SQuAD-like dataset in Chinese. It should have the same...

I often use a pytest plugin that performs flake8 tests in the CI: https://github.com/tholo/pytest-flake8 We just need to update the following line: https://github.com/cdqa-suite/cdQA/blob/7b80682eddcf6e9b4f92371123e2ff79c6304e30/.travis.yml#L8

Hi @weinixuehao Which pre-trained bert model are you using? Ideally you want to use `bert-base-chinese` that has a chinese tokenizer included. See https://github.com/huggingface/transformers/blob/94c99db34cf9074a212c36554fb925c513d70ab1/transformers/tokenization_bert.py#L40

Probably an incorrect json format It would be nice for the user to receive an error screen in that case