Splitting tests with awareness of skips

I have two settings for CI

a) run all the tests on GPU b) run a subset of the tests on CPU the subset is because many tests are decorated with pytest.mark.skipif(not os.environ['IS_CUDA'])

when I run b with any number of splits one of them is empty.

Do I need to make a second durations file or is there a way to make the splitter know which tests will be skipped?

I would also benefit from this. I have a significant number of tests I mark skipped and if they all get packed into the same group with no non-skipped items it causes things to break.