3Ranorex - Advantages Cross platform support Test Automation Library for .NetStandard programming langauges C# and VB.Net for scriptingTest development environment (Ranorex Studio) features recorder, debugger, object spy and repositoryFlexible Test Automation Library Interface Test suites with Ranorex results in .EXE files for simple integration with test management, behaviour driven development and continuous integration server toolsCustomizable Test report engine.
4How does it work? Gherkin Device/Simulator Android + Run Tests 4. Specflow reads bdd(formatted in Gherkin)Device/Simulator3. Team city runs Visual Studio project6. Test Scriptsruns on RT App.5. Connects to device through WiFiAndroidRun Tests(TeamCity Server)+Visual StudioRT App(Our Build)SpecFlowRanorex LibraryiOS2. .Exe is stored in repository1.BDD Stories are turned into Visual studio projects3333WindowsBDD StoriesSVN
5Ranorex-Disadvantages Xamarin related automation IssuesSupport takes more time for Xamarin related issuesRanorex agent compatibility with Application is poor and causes crashing as new features are introduced in appInstrumented application is slower than original ApplicationSome Touch gestures/Drag and drop operation not supportedIn case of crashing/hanging, Automatic launching of closed Application is not supportedNeed to provide long waiting times for object identification.
6Appium - Advantages Active community No extra code into application Open source – we can make our own fixes and ask for pull requests on githubEasier to learn and implement than CalabashElement inspector in Appium app
7Appium - Disadvantages Over 50 open bugs with iOSUnable to get hooks on certain elements in complicated apps(programme detail page).https://github.com/appium/appium/issues/537Inconsistent with outcomes(due to no wait/delay)Currently cannot drag – known logged bug
12Conclusion Best tool to use is Calabash: Owned and supported by XamarinMore stable and reliable, testing is more consistent.Easier to setup the BDD layer for QA’s
13(formatted in Gherkin) How does it work?Gherkin1. Team city runs Cucumber scripts.2. Cucumber reads BDD(formatted in Gherkin)AndroidRun Tests(TeamCity Server)CucumberCalabashXamarin(Our Build)iOS3. From the parsed Gherkin files, Cucumber runs the retrieved Ruby files and methods.WP4. Ruby talks to calabash to run commands on the platforms.Ruby