Andrew Ho

fromJSON is very slow in simplifyDataFrame function

1

Hi, I'm using a package which translates ElasticSearch queries (JSON format) to data.tables. The issue is that it's very slow, and majority of the time seems to spent in jsonlite's...

Intermittent failures during Post Setup Python step for MacOS

1

I'm new to Github Actions and I'm having trouble understanding this failure, apologies if this isn't the right way to flag the issue. **Description:** Post Setup Python fails intermittently with...

Update actions/setup-python from v4 -> v5

1

MacOS continues to fail during intermittently during shutdown step. Before creating an issue in actions/setup-python let's try upgrading this to V5 Fixes #{issue number} ### Changes - -

Shard StatefulDataLoader tests

3

Fixes #1256 ### Changes * Rename test_state_dict tests so they are easy to shard in CI Actions - -

MacOS state_dict tests in CI are failing during shutdown

2

### 🐛 Describe the bug MacOS tests of StatefulDataLoader CI action fail intermittently during shutdown. on Mac it also takes a lot longer than both windows and ubuntu to shut...

[RFC] Polylithic: Enabling multi-threaded DataLoading through non-monolithic parallelism

7

This RFC was re-created due to a problem with the original. Summary of comments from previous issue below. ### 🚀 The feature **TL;DR \-** We want to lean into **modular...

### 🚀 The feature We should include builds for Python 3.13 though listed as experimental in order to start testing against FT/NoGIL python ### Motivation, pitch NoGIL is going to...

### 🐛 Describe the bug CI for Ubuntu / Linux in stateful dataloader takes about 20 seconds, but for mac and windows takes about 30+ minutes. Not only burning a...

### 🚀 The feature State Dict utilities to inspect state ### Motivation, pitch We should provide some utilites for users to inspect and potentially modify the dataloader state. Currently the...

[BE] Nightly Release has been failing but no alerting

1

### 🐛 Describe the bug Nightly release has been failing for a couple of months, but we weren't aware. Figure out alerting on these failures https://github.com/pytorch/data/actions/runs/11031708385 ### Versions main