burn icon indicating copy to clipboard operation
burn copied to clipboard

Add `DataframeDataset` example

Open wangjiawen2013 opened this issue 1 year ago • 4 comments

Hi, The dataframe dataset has already been merged into burn and is demonstrated in burns book: image

But I cannot find it in burn's docs and examples, where is it ?

wangjiawen2013 avatar Oct 23 '24 03:10 wangjiawen2013

Hello,

The code is separated in differents crates. You Can find the dataset crate under the crates folder: https://github.com/tracel-ai/burn/tree/main/crates%2Fburn-dataset.

You can find an example of the InMemDataset:

  • InMemDataset: https://github.com/tracel-ai/burn/tree/main/examples/custom-csv-dataset

I don't know if there are more examples

HessTaha avatar Oct 23 '24 10:10 HessTaha

Right now there are no examples which make use of the DataframeDataset (which is under the dataframe feature flag for the dataset module).

I agree that it would be nice to have at least a snippet for its usage. I'll convert this issue to track this addition.

laggui avatar Oct 23 '24 15:10 laggui

Yeah it'd be great if we have example. Meanwhile you can see some basic tests:

https://github.com/tracel-ai/burn/blob/main/crates/burn-dataset/src/dataset/dataframe.rs

antimora avatar Oct 28 '24 17:10 antimora

BTW, the API is available via a dataframe feature flag.

antimora avatar Oct 28 '24 17:10 antimora