unitxt
unitxt copied to clipboard
description, homepage, and citation obtained from HF with datasets.load_dataset_builder
Hi @michal-jacovi and @elronbandel , Just to kickoff, I tweaked test_card, making it invoke load_dataset_builder (rather than LoadHF), and printed the description, citation, homepage, and whatever that load_dataset_builder harvested for me. I ran test_preparation to activate the tweak over all cards. Not too many surrendered descriptions, but at least we have something to begin with. If the 5 descriptions thus obtained make sense, I will complete for the other cards, and look for more ways to harvest.