We are using Xamarin Test Cloud to smoke test a native iOS & Android control library with Xamarin.iOS and Xamarin.Android bindings. Our goal is in UITests to simply run the demo / examples app and to click on each example. We check for runtime crashes as a simple smoke test 'Does it work' before deploying the latest binaries to NuGet. This allows us to quickly rule out runtime errors that result from xamarin bindings.
Anyway, we are finding that Xamarin Test Cloud is extremely slow to run tests. We're not sure if this is our tests, or the infrastructure of Xamarin as yet. We have 25 Xamarin.Android tests so far which we want to run on one device only, and they seem to take half an hour to run. That's 1 minute per test. We want to add a couple of hundred tests and are pretty worried about the escalating costs and how we'll soon be bumped into the 'Enterprise' tier just for a small number of smoke tests for one app on one device ...
See supplementary information below. One specific test takes
Obviously at this speed it kind of makes XTC unusable as we cannot add more than a small number of tests before we a.) run out of money b.) our build server times out with hanging builds or c.) our developers go insane from waiting
Any help appreciated!!