I love tools. And the fact that this flora of tools increases rapidly you have to keep your self up-to-date. Todays #1 tools could be garbage tomorrow. It’s exiting to follow the development pattern in mobile testing.
Here’s a sample of mobile tools that I’ve tried out!
“Official” mobile testing framework
- JUnit: Automation of Android Apps the with Java code. Works great in Eclipse with the Android SDK.
- Robotium: The Best Open Source Android Native application testing framework at the moment. Integrates well with hardware components.
- Selenium Web automation on iOS and Android driven by a WebDriver client. With a creative mind and some coding skills you could build your own testing framework with Selenium and Jenkins
- Sikuli: Sikuli Script automates anything you see on the screen. It uses image recognition to identify and control GUI components. This tool will only work with the iOS & android emulators, but not the physical devices unless you’re running a vnc client to controll the physical devices. Works like a charm on Android, but you have to Jailbreak your iOS device in order to install VNC on it.
- Calabash: Calabash enables you to write and execute automated acceptance tests of mobile apps. Calabash is cross-platform, supporting Android and iOS native apps.
- Apache JMeter: Could be used to load test traffic from a mobile application
Functional automation tools
- Testdroid: Comprehensive test automation solution from Bitbar that supports Android and iOS. They are using the Robotium framework for the Android part along with the Instruments and JS for iOS. You are able to run tests in parallel with their local solution as well as running your scripts in their cloud on over 160 different devices
- Jamo Solutions: Functional Automation with a cool Object-Spy feature
- AppThwack: Appthwack provides a device lab and can auto generate tests. I feel it’s not quite yet ready for the market, but looks promising, so I believe they can achieve greatness in the future.
- Perfecto Mobile: Remote desktop testing for mobiles. Great idea but quite expensive.
- Device Anywhere: Similar features as Perfecto Mobile, but with another pricing plan
- Eggplant: GUI driven test tool from TestPlant that can test across platforms and automate software testing using a black-box approach.
- SOASTA CloudTest: Comes with a VMWare server that’s really easy to install. Runs on multiple OS.
- Ranorex: UI automated testing tools enable testing of many different application types. Lags quite a lot on windows when trying to record scripts.
- SilkMobile (SeeTest): Really smooth scripting possibilities but lack of executing test scripts on multiple devices in parallel
- Frank: allows you to write structured text test/acceptance tests/requirements (using Cucumber) and have them execute against your iOS application.
- Expensify – Windows Phone Test Framework: This NUnit framework was so promising, but unfortainly last update was over a year ago. Demo
- Neoload: Great Tool for generating load on the server and client side. Handles the most of the common used protocols
- OWASP – Mobile Security Project: A great set of guidelines on how to build, test and maintain secure mobile applications