Support including data in the training dataset but not in the testing dataset

This would be helpful in cases where we need to include more data, but these data do not represent what the model will be exposed to once it is deployed in production.