Test Suites

[selsamman]

trafficstars

Given the interest in expanding the capabilities of this library I feel that a test suite would be helpful. It would make pull requests a lot easier test and serve as good reference when a question comes up about a particular device.

I am working towards a suite here - https://github.com/selsamman/android-transcoder.git and did a proof of concept by transcoding a small file using Instrumentation and simple JUnit (not Expresso). Basically the instrument test piggy backs off the sample app though it really just does JUnit test on the underlying transcoder classes rather than driving the example app.

It runs fine on a USB device but still have issues with getting cloud testing going. AWS seems to be looking for Setup test and skips the suite. Starting to think straight-up JUnit (without activities) are not really compatible as all examples use Expresso or other frameworks. In the Google cloud sometimes tests run twice and I get quite a lot failure on Nexus 6 phones though Nexus 5 phones seem to be fine. I will keep working on this but still have a few questions and some need for direction:

• First is this something that is desirable and worthwhile to work on?
• How much testing should be done in terms of various input files, output strategies, different videos
• I am adding the sample clips to androidTest/res/raw. For now there is only one file but this could potentially get big. Only affects the test apk and the repo size.
• How much compatibility is really expected. I understand ypresto has done some testing on the farm so curious as to how that was done. I am wondering if you need to transcode videos actually shot on the various devices which would make things harder.

Any direction would be appreciated.