Open-Assistant icon indicating copy to clipboard operation
Open-Assistant copied to clipboard

Add iapp_wiki_qa_squad to datasets

Open wannaphong opened this issue 1 year ago • 14 comments

iapp_wiki_qa_squad is an extractive question answering dataset for Thai.

It's use MIT License.

  • added notebook that loads the CMU Wiki QA dataset then cleans / filters it and saves it in Assistant's prompt format
  • added README.md based on HF data card
  • added requirements.txt for notebook collab use
  • updated init.py to include HF datase

Hugging Face Hub: https://huggingface.co/datasets/wannaphong/iapp_wiki_qa_squad_oa

wannaphong avatar Feb 27 '23 16:02 wannaphong

This looks good to me. There is an excel file we keep track of our datasets and a checklist now to make sure we have everything we need for new datasets. @Vechtomov and @bitplane can tell you more :) thank you again @wannaphong !!

huu4ontocord avatar Feb 27 '23 16:02 huu4ontocord

:x: pre-commit failed. Please run pre-commit run --all-files locally and commit the changes. Find more information in the repository's CONTRIBUTING.md

github-actions[bot] avatar Feb 28 '23 17:02 github-actions[bot]

:x: pre-commit failed. Please run pre-commit run --all-files locally and commit the changes. Find more information in the repository's CONTRIBUTING.md

github-actions[bot] avatar Feb 28 '23 17:02 github-actions[bot]

:x: pre-commit failed. Please run pre-commit run --all-files locally and commit the changes. Find more information in the repository's CONTRIBUTING.md

github-actions[bot] avatar Feb 28 '23 17:02 github-actions[bot]

:x: pre-commit failed. Please run pre-commit run --all-files locally and commit the changes. Find more information in the repository's CONTRIBUTING.md

github-actions[bot] avatar Feb 28 '23 17:02 github-actions[bot]

:x: pre-commit failed. Please run pre-commit run --all-files locally and commit the changes. Find more information in the repository's CONTRIBUTING.md

github-actions[bot] avatar Feb 28 '23 17:02 github-actions[bot]

@ontocord @Vechtomov @bitplane I think It's ready.

wannaphong avatar Feb 28 '23 17:02 wannaphong

:x: pre-commit failed. Please run pre-commit run --all-files locally and commit the changes. Find more information in the repository's CONTRIBUTING.md

github-actions[bot] avatar Feb 28 '23 17:02 github-actions[bot]

:x: pre-commit failed. Please run pre-commit run --all-files locally and commit the changes. Find more information in the repository's CONTRIBUTING.md

github-actions[bot] avatar Feb 28 '23 17:02 github-actions[bot]

:x: pre-commit failed. Please run pre-commit run --all-files locally and commit the changes. Find more information in the repository's CONTRIBUTING.md

github-actions[bot] avatar Feb 28 '23 17:02 github-actions[bot]

:x: pre-commit failed. Please run pre-commit run --all-files locally and commit the changes. Find more information in the repository's CONTRIBUTING.md

github-actions[bot] avatar Mar 01 '23 02:03 github-actions[bot]

:x: pre-commit failed. Please run pre-commit run --all-files locally and commit the changes. Find more information in the repository's CONTRIBUTING.md

github-actions[bot] avatar Mar 01 '23 02:03 github-actions[bot]

:x: pre-commit failed. Please run pre-commit run --all-files locally and commit the changes. Find more information in the repository's CONTRIBUTING.md

github-actions[bot] avatar Mar 01 '23 16:03 github-actions[bot]

@Vechtomov Do you want to clean the notebook?

wannaphong avatar Mar 01 '23 16:03 wannaphong

:x: pre-commit failed. Please run pre-commit run --all-files locally and commit the changes. Find more information in the repository's CONTRIBUTING.md

github-actions[bot] avatar Mar 02 '23 17:03 github-actions[bot]

:x: pre-commit failed. Please run pre-commit run --all-files locally and commit the changes. Find more information in the repository's CONTRIBUTING.md

github-actions[bot] avatar Mar 02 '23 17:03 github-actions[bot]

pre-commit is the worst for notebook. Now, I clean all cell if it still error I will give up.

wannaphong avatar Mar 02 '23 17:03 wannaphong

:x: pre-commit failed. Please run pre-commit run --all-files locally and commit the changes. Find more information in the repository's CONTRIBUTING.md

github-actions[bot] avatar Mar 02 '23 17:03 github-actions[bot]