Kaiwen Wang

Hello! I'm interested in using pydantic's recursive constructor / asdict functionality, but jax.jit-ed functions give the following error: ``` Argument '_Pydantic_OptimConfig_93971134241088(.. SOMETHING HERE...)' of type is not a valid JAX...

global context not imported in transform_spec function with reader_pool_type="process"

5

Hello, I'm blocked on trying to perform some preprocessing (i.e. transform) on the data before returning from the (Pytorch) dataloader. However, my preprocessing function's return type is a dataclass, rather...

Petastorm PyTorch dataloader slower than JSON

3

I'm converting my JSON readers to use Petastorm to be more scalable. However, I found that the Petastorm Dataloader takes around 20x the time to iterate through an dataset as...

Hi, I could not find the propensities of the logging policy in the dataset. Can they be made available, since importance weighted methods would benefit from that knowledge? Thanks!