Recently, we noticed some of our UITests were timing out because a test was taking more than 30 minutes to complete.
After researching more into it, we realized that running tests in Test Cloud for Android takes significantly longer than when running locally.
For starters, we thought maybe screenshots were slowing down the test time, and so we did the following test runs to get the times for each. We ran the same suite of tests for each of the times/test runs below:
ANDROID (Nexus 6P, Nougat 7.1.1) Locally -- no screenshots Emulator —> 4:35 Physical Device —> 5:31 Locally -- screenshots enabled Emulator —> 7:04 Physical Device —> 7:38 Test Cloud -- screenshots always enabled Device —> 44:00
Does anyone know why tests run in Test Cloud for Android are ~6x slower than running locally, even on a physical device?