dspy icon indicating copy to clipboard operation
dspy copied to clipboard

feature: add dl.from_json to support native json dataset formats

Open poppingtonic opened this issue 1 year ago • 2 comments

from dspy.datasets import DataLoader
dl = DataLoader()
json_dataset = dl.from_json("/home/path-to/sample_responses.json", fields=["question", "answer", "context"])
# joy ensues...

poppingtonic avatar Feb 19 '24 23:02 poppingtonic

LGTM

insop avatar Feb 20 '24 00:02 insop

Thank you so much @poppingtonic ! @krypticmouse does this fit your idea of the loader? Feel free to merge if so!

okhat avatar Feb 25 '24 23:02 okhat

Yes this is perfect :slightly_smiling_face: . Thanks for the contribution @poppingtonic!!

Merging it!

krypticmouse avatar Feb 26 '24 06:02 krypticmouse