context-is-key-forecasting icon indicating copy to clipboard operation
context-is-key-forecasting copied to clipboard

Release CiK (Context is Key) dataset on Hugging Face

Open NielsRogge opened this issue 10 months ago • 9 comments

Hello @AndrewRobertWilliams 🤗

Niels here from the open-source team at Hugging Face. I discovered your work on Arxiv and was wondering whether you would like to submit it to hf.co/papers to improve its discoverability. If you are one of the authors, you can submit it at https://huggingface.co/papers/submit.

The paper page lets people discuss about your paper and lets them find artifacts about it (your dataset for instance), you can also claim the paper as yours which will show up on your public profile at HF.

Would you like to host the datasets you've released on https://huggingface.co/datasets? I see you're using a custom website for it. Hosting on Hugging Face will give you more visibility/enable better discoverability, and will also allow people to do:

from datasets import load_dataset

dataset = load_dataset("your-hf-org-or-username/your-dataset")

If you're down, leaving a guide here: https://huggingface.co/docs/datasets/loading. We also support Webdataset, useful for image/video datasets: https://huggingface.co/docs/datasets/en/loading#webdataset.

Besides that, there's the dataset viewer which allows people to quickly explore the first few rows of the data in the browser.

After uploaded, we can also link the datasets to the paper page (read here) so people can discover your work.

Let me know if you're interested/need any guidance.

Kind regards,

Niels

NielsRogge avatar Feb 10 '25 19:02 NielsRogge

Hi, we plan to do this in the coming days. I'll keep this issue open until this is done.

ashok-arjun avatar May 02 '25 14:05 ashok-arjun

Hi, thanks for the wonderful work. May I know when the dataset will be released? I only found one example dataset. Thank you in advance.

Caelyn-gao avatar Jul 10 '25 07:07 Caelyn-gao

Hi, thanks for the wonderful work. May I know when the dataset will be released? I only found one example dataset. Thank you in advance.

Hi, we plan to do this in the coming days. I'll keep this issue open until this is done.

Hi, could you please release the datasets soon?☺

9394-lab avatar Aug 03 '25 07:08 9394-lab

The dataset in Hugging Face format, converted to JSON is available here: https://github.com/ServiceNow/context-is-key-forecasting/blob/main/results/all_tasks.json We still plan still plan to have it available on Hugging Face directly, but there are a few technicalities we need to handle internally first.

marcotet avatar Aug 05 '25 13:08 marcotet

Sounds good! Here's a guide: https://huggingface.co/docs/datasets/loading#json. You can do dataset.push_to_hub to make it available on Hugging Face.

NielsRogge avatar Aug 08 '25 15:08 NielsRogge

Here is the link to the HuggingFace version of the dataset: https://huggingface.co/datasets/ServiceNow/context-is-key The dataset contains the same information as the JSON (the JSON was created from it).

marcotet avatar Aug 08 '25 16:08 marcotet

Ok thanks! Feel free to link it in the README of this Github repo

NielsRogge avatar Aug 08 '25 16:08 NielsRogge

Ok thanks! Feel free to link it in the README of this Github repo

Good point, I add it to the header.

marcotet avatar Aug 08 '25 17:08 marcotet

Btw sidenote, would be cool to have the dataset at https://huggingface.co/ServiceNow (I see ServiceNow is paying for the Enterprise plan)

NielsRogge avatar Aug 08 '25 17:08 NielsRogge