TransmogrifAI
TransmogrifAI copied to clipboard
salesforce
Improve test coverage for transformers & estimators
Problem Some of our transformers & estimators are not thoroughly tested or not tested at all.
Solution
Use OpTransformerSpec and OpEstimatorSpec base test specs to provide tests for all existing transformers & estimators.
After a quick survey of com.salesforce.op.stages.impl.feature, found the following:
These classes don't appear to have associated tests:
- FilterMap
- OpIndexToString (just a wrapper for Spark IndexToString, though)
- OpLDA (has test, OpLdaTest, but names don't match)
- OpOneHotVectorizer
- OpScalarStandardScaler (OpStandardScalerTest exists but names don't match)
- RealNNVectorizer
- TextMapPivotVectorizer (tested in both OPMapVectorizerTest and TextMapVectorizerTest but names don't match)
- Transmogrifier (TransmogrifyTest exists but names don't match)
These tests exist but do not extend OpTransformerSpec or OpEstimatorSpec
- Base64VectorizerTest
- DateMapVectorizerTest
- DateTimeVectorizerTest
- DateVectorizerTest
- EmailParserTest
- EmailVectorizerTest
- FillMissingWithMeanTest
- GeolocationVectorizerTest
- HashingTFTest
- IntegralVectorizerTest
- IsotonicRegressionCalibratorTest
- LinearScalerTest
- MultiPickListMapVectorizerTest
- NGramSimilarityTest
- NGramTest
- NumericBucketizerTest
- NumericVectorizerTest
- OPCollectionHashingVectorizerTest
- OPCollectionTransformerTest
- OpCountVectorizerTest
- OpIndexToStringNoFilterTest
- OpLdaTest
- OPMapVectorizerTest
- OpSetVectorizerTest
- OpStandardScalerTest
- OpStringIndexerNoFilterTest
- OpStringIndexerTest
- OpWord2VecTest
- PercentileCalibratorTest
- PhoneNumberParserTest
- RealVectorizerTest
- ScalerMetadataTest
- ScalerTest
- SmartTextMapVectorizerTest
- TextMapVectorizerTest
- TextTokenizerTest
- TextTransmogrifyTest
- TextVectorizerTest
- ToOccurTransformerTest
- TransmogrifyTest
- UniqueCountTest
- URLVectorizerTest
Hi guys, I would like to help contributing and this seems like a good place to start. Any tips or places to look to help me getting up and running with implementing some of these tests?
Hi @Sammyalhashe! There are still some tests in the list above that need to be updated. I would go through there and find the tests that don't extend OpTransformerSpec or OpEstimatorSpec. You can look at the tests that do extend them and at the PR's that reference this issue for examples on what to do.