wiktextract icon indicating copy to clipboard operation
wiktextract copied to clipboard

pre-extracted data in .tsv format

Open Digital-XxX opened this issue 2 years ago • 6 comments

Please give me pre-extracted data in .tsv format please. Goldendict mobile cannot read .json dictionaries.

Digital-XxX avatar Jul 11 '22 10:07 Digital-XxX

Unfortunately the data we provide is not suitable to be used straightforwardly in .tsv or .csv. The JSON data is hierarchical, with big and reasonably sprawling word structures that contain smaller structures, dictionaries and lists, and translating that to .tsv needs to be done on a case-by-case basis. It's not a universal data format that is swappable between different programs (at least yet, or in the near future), it's just a bunch of data we've put into an adhoc data structure as need be.

To make what you want possible you need to:

We welcome any contributions to the project to make it more accessible.

kristian-clausal avatar Jul 11 '22 10:07 kristian-clausal

  • program a script that will do that translation by reading the json file object-by-object and then outputting it into .tsv

I think pyglossary supports conversion of .json to .tsv/.tab

Digital-XxX avatar Jul 11 '22 10:07 Digital-XxX

  • program a script that will do that translation by reading the json file object-by-object and then outputting it into .tsv

I think pyglossary supports conversion of .json to .tsv/.tab

We would be happy to have someone implement a conversion utility for our .json to other formats, but someone has to code it first, and our data structure and format can change as time goes by.

kristian-clausal avatar Jul 11 '22 11:07 kristian-clausal

I created a project that is able to create tsv/stardict/kindle dictionaries from the kaikki dump. It is only not extremely well tested, but possibly it works: https://github.com/Vuizur/ebook_dictionary_creator

Vuizur avatar Jul 27 '22 16:07 Vuizur

I also now have a repository with directly downloadable dictionaries for a lot of languages in 3 different formats: https://github.com/Vuizur/Wiktionary-Dictionaries

Vuizur avatar Aug 22 '22 11:08 Vuizur

Here is a new tool: https://codeberg.org/GrimPixel/Text_to_Wordlist You can place your text file in the corresponding directory 0_text, then check the text_setting.yaml and dictionary_setting.yaml, then run extract_text.py and extract_dictionary.py to generate a TSV file with values separated as described in README.adoc.

GrimPixel avatar Apr 08 '24 14:04 GrimPixel