On the road: Test automation in practice for a BMW map update service

Agenda About Testbirds and the speaker: Felix Kuperjans Components of the presented project: Jubula – an Eclipse Plug-in BMW Download Manager TestChameleon™ by Testbirds How the test works Demo Conclusion: Results and advantages

Testbirds Our History Vision: “The World’s Leading Company for Innovative Testing Services” Founded in 2011 / Trusted by 500+ clients / Executed 1200+ projects Origins in the enterprise software testing market Quality assurance and UX/Usability testing utilising crowd and cloud technologies Customer satisfaction 9.2 out of 10 Winner of the German Innovation Award 2017 and one of the Top 10 European B2B Scale-Ups according to Google, Rocket Internet and McKinsey

About the Speaker Felix Kuperjans Bachelor‘s Degree in Computer Science from TU München Developer at Testbirds since 2013 Working mainly at Cloud platform TestChameleon™ Feel free to contact me also after the event: f.kuperjans@testbirds.de

Components of the presented project Jubula – an Eclipse plug-In Jubula is an Eclipse plug-in by BREDEX, which provides automated functional GUI testing for various types of applications. especially useful to test native GUI applications automated tests to be written by test experts from the user perspective, without requiring any coding effort enables behavior-driven development Integrated into the Eclipse IDE or as a standalone version BREDEX offers additional features and options for productivity and comfort in testing

Components of the presented project BMW Download Manager The BMW Download Manager is an update service by BMW for the navigation systems of their cars available on Connected Drive Portal installation by connecting a USB stick with the system in the car Native Java UI with JavaFX Why a native application and not everything in the web? Download and installation of very large files can be better resumed

Components of the presented project TestChameleon™ When dealing with complex projects or test automation, it’s common to create a virtualised testing environment Reduce configuration and maintenance costs with the help of our SaaS solution, TestChameleon™ VMs for common desktop an mobile operating systems Real devices available from our Global Real Device Network Manual control of the VMs and devices or automated testing using various tools

Components of the presented project TestChameleon™ What it does: Enables you to locate and understand defects and software incompatibilities Ensuring a consistent UX on all available OS, browser and software combinations Automating your tests with scripts such as Selenium or Appium Other tools like Jubula are supported, too Can be used for any kind of platform testing, also beyond web testing as in the presented project Full control of the VM, also for software installation

How the test works Tools Download of the BMW Download Manager from the Connected Drive portal is automated with Selenium The downloaded app is tested with Jubula  Both is done in a single test Jenkins manages the test execution and collects results Jubula distributes execution with AUT agents

How the test works Tools Jubula distributed test execution AUT Agents run the actual test with the application Testexec runs the test execution and connects to the agents Test definition is stored in a database Test results can be collected by testexec in various formats TestChameleon™ cloud

How the test works Test execution 1. Jenkins starts VMs on TestChameleon™ 2. Selenium web test: logs into BMW Connected Drive portal and downloads the BMW Download Manager 3. Jubula distributes the execution with testexec to the Jubula AUT agents 4. Jenkins collects results from the Selenium web test and the Jubula report from testexec All this is done multiple times on different VMs, e.g. Windows 7 and Windows 10 Can be done one after the other or in parallel

Demo

Conclusion Results and advantages UI testing is a good method for end-to-end tests, especially on various platforms With a Cloud solution you do automatically get any platform you need Remote test execution: tests in the Cloud are also possible with Jubula Web and application testing combined to automate the complete user flow  

Q&A  

Evaluate the Sessions Sign in and vote at eclipsecon.org - 1 + 1