JIVING WITH JENKINS Making the CI server dance to your tune JOHN SHEPHERDSON, ASSOCIATE DIRECTOR, TECHNICAL SERVICES UK DATA ARCHIVE 17 April 2014 V1.0

DANCE CARD 2 Introductions Basic steps  Hoofing with Hudson  Stepping with Selenium  Tangoing with TV Fancy footwork  Dream Ballet  Sequence Dancing  Jiving with Jenkins

UK Data Archive 3 based at the University of Essex since 1967 curator of the UK’s largest collection of digital data in the social sciences currently holds nearly 6,000 data collections for research and teaching, both quantitative and qualitative certified to ISO 27001, the international information security standard makes these available via the new UK Data Service Website:

UK Data Service 4 the UK Data Service indexes all data collections in the Archive –all catalogued at thematic level –many indexed at variable level also harvests metadata from other sources all are available for download via Discover search-and-browse catalogue: discover.ukdataservice.ac.uk discover.ukdataservice.ac.uk

UK Data Service 5 also provides access to UK Census data (1971 to 2011) source of guidance, training, and support for data users in UK and around the world currently serve approx. 24,000 registered users newly funded to coordinate the Administrative Data Research Network, part of UK’s Big Data strategy Websites: ukdataservice.ac.uk, census.ukdataservice.ac.ukukdataservice.ac.uk led by experts at University of Essex along with colleagues at Manchester, Leeds, Southampton, Edinburgh and UCL

6 BASIC STEPS

HOOFING WITH HUDSON 7 Basic CI stuff Instrumentation Unit testing Style checking Documentation

Instrumentation 8 Job Status Build History

Instrumentation 9 Build artefacts Revision history Audit trail

Unit Testing 10

Style Checking 11 Stylecop CheckStyle

Code QA - Sonar 12

Code QA - Sonar 13

Database docs (Red Gate SQL Doc) 14

Database docs (Red Gate SQL Doc) 15

Class docs (dOxygen) 16

Class docs (dOxygen) 17

STEPPING WITH SELENIUM 18 User Journey assurance Plugin to Firefox Allows User clicks to be captured convert to test scripts run on demand Selenium Grid test multiple browser types and variants See ‘Browser Watch’ presentation for more details

STEPPING WITH SELENIUM 19 User Journey assurance

STEPPING WITH SELENIUM 20 User Journey assurance

TANGOING WITH TV 21 Other QA/Validation: Link checking, Spelling, HTML standards compliance, Accessibility

FANCY FOOTWORK

DREAM BALLET 23 Deployment Copy builds, configuration, data from server to server Keep test instance data in step with production How? Wrap a tool (such as RoboCopy or Red Gate deployment manager) in a script (such as Ant) and call it from Jenkins.

SEQUENCE DANCE 24 Upstream/downstream builds Build dependency chain – Harvest data via web service API – Import harvested data in to XML database – Run quality checks against database contents – Extract data etc.

JIVING WITH JENKINS 25 From Continuous Integration to Orchestration Minimal coding – Mostly configuration – Some scripting (Ant, Shell, DOS etc.) – Chain internally and/or call externally (REST API) – Rich instrumentation – Notification on success and/or failure Make your CI server dance to your tune!

26 Jirahttp:// Jira Agilehttps:// SVNhttp://subversion.apache.org/ SVN Edge Jenkinshttp://jenkins-ci.org/ Seleniumhttp://docs.seleniumhq.org/ Stylecophttp://stylecop.codeplex.com/ Resharperhttp:// Red Gatehttp:// Doxygenhttp:// Sonarhttp://

Find Out More 27 Find out more  Data Archive – data-archive.ac.uk  UK Data Service – ukdataservice.ac.uk Contact Information  John Shepherdson UK Data Archive University of Essex  Wivenhoe Park Colchester CO4 3SQ