Passing a mask on `y` won't work due to autosklearn resampling

[bofei5675]

I'm working on a project that needs me to pass a mask of label into the scorer. For example, if y is a vector (100,), then I will have a boolean mask with the same size.

After passing this mask, I found that the resampling strategy used hold-out set then this mask won't be able to match with the original vector size. I'm just wondering how can I fix this? Also, if someone can point out which part of code does the splitting, it would be definitely helpful.

Thanks!

[mfeurer]

Unfortunately, this feature is not implemented yet. Auto-sklearn uses scikit-learn code for splitting. Does scikit-learn allow this?

[github-actions[bot]]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs for the next 7 days. Thank you for your contributions.