weave icon indicating copy to clipboard operation
weave copied to clipboard
verified publisher icon wandb

feat(weave): HF.Datasets <-> weave.Dataset

Open tcapelle opened this issue 8 months ago • 1 comments

Adds simple to_hf and from_hf methods to weave.Dataset so we can do the processing leveraging the fast and battle tested datasets library.

tcapelle avatar May 01 '25 10:05 tcapelle

Preview this PR with FeatureBee: https://beta.wandb.ai/?betaVersion=ccac96428784c492faaaf2a822cc88e3bcde4bdf

circle-job-mirror[bot] avatar May 01 '25 10:05 circle-job-mirror[bot]

Can we merge this @andrewtruong ?

tcapelle avatar May 19 '25 12:05 tcapelle