1. Prepared by Peter Boško, Luxembourg June 2012
2.6.1 e-Collect-X : application for microdata collection with integration into SDMX
Prepared by Peter Boško, Luxembourg June 2012
Uvodny slide

2. Brief project history 1/3
ESSNet on SDMX project - Support of SDMX application for micro data handling, within statistical business process at the NSI level
Two phases yet, each took 18 months
First phase – October 2009 – March 2011
Second phase – April 2011 – September 2012
Textovy slide

3. Brief project history 2/3
First phase
Main objectives :
To apply SDMX standard in the earliest phases of survey design and survey processing (data collection) at the NSI level,
To preserve the metadata from the initial phases of survey design, while designing e.g. questionnaire, and use it in descriptions of micro-database for later use either internally at NSI or externally,
To collect data electronically (e-collection)
Textovy slide 3

4. Brief project history 3/3
Second phase
Main objectives :
Enhance the functionality of application to make it usable for real data collection in NSIs
Simplify questionnaire definition – anyone able to write Word document must be able to define a questionnaire
Implement complex validations on client side (javascript validation engine)
Implement on screen calculations on client side (javascript calculation engine)
implementation of binded Hierarchical code lists (user selects a Region from select box and list of countries in another select box on screen is refreshed and updated)
implementation in real world – NSI in Bulgaria
Develop simple way how to integrate e-Collect-X with standard SDMX tools – current version supports integration with Mapping assistant – (generation of DSD files and select statements that are required to make data exposed via SDMX web service).
Integrator module touches Mapping Assistant database and sets up Mapping assistant content. It is done on a push of a button in eCollect-X application
Create comparison study with DDI capabilities in describing microdata
Textovy slide 4

5. State of goals achievements in second phase
Green – already Done
Blue - Ongoing
Enhance the functionality of application to make it usable for real data collection in NSIs
Simplify questionnaire definition – anyone able to write Word document must be able to define a questionnaire – DONE (will be demonstrated)
Implement complex validations on client side (javascript validation engine) – DONE (will be demonstrated)
Implement on screen calculations on client side (javascript calculation engine)
implementation of binded Hierarchical code lists (user selects a Region from select box and list of countries in another select box on screen is refreshed and updated) - ONGOING
implementation in real world – NSI in Bulgaria - ONGOING
Develop simple way how to integrate e-Collect-X with standard SDMX tools – current version supports integration with Mapping assistant – (generation of DSD files and select statements that are required to make data exposed via SDMX web service). - DONE (will be domonstrated)
Create comparison study with DDI capabilities in describing microdata - ONGOING
Textovy slide 5

6. Future of project
Currently looking for way how to finance further development (no other ESSNet project)
Important will be results of pilot implementation in Bulgaria
Textovy slide 6

7. Basic principles and functionality of e-Collect-X application 1/2
Each questionnaire is same way like artefacts in SDMX versionable and maintainable element – is identified by assigned ID, VERSION and maintaining AGENCY. Means that waves of surveys can be easily managed with different versions of same questionnaire
Every questionnaire can be split into smaller logical parts – so called modules (bigger flexibility in terms of modularity is achieved)
Every questionnaire can consist of multiple modules, every assignment of module can be parameterized
module can be opened (multiple rows)
minimum and maximum number of module rows can be specified
each questionnaire must have at least one so called identification module, which identifies all collected data in questionnaire
module can be binded to questionnaire with so called last bind – when new version of same module is created is automatically used in questionnaire instead of older version
Textovy slide 7

8. Basic principles and functionality of e-Collect-X application 2/2
Questionnaire GUI can be easily defined in WYSIWYG editor – questionnaire design in terms of formating, colors, fonts, pictures, tables support, data items support, etc… is very easy and intuitive. WYSIWYNG editor also supports binding of data items to codelists stored in application (Codelists can be uploaded from XML files created in SDMX tools – Data Structure Wizard). Various types of GUI items are supported – Text box, Text area, single check box, Checkbox list attached to codelist, Radio button list attached to codelist and Select box attached to codelist.
Integration to SDMX consist of :
Automatic generation of DSD file on the fly – application allows to download file
Generator of SQL Select statement which can be run against database and allows to retrieve collected data of questionnaire
Integration to Mapping Assistant – software module touches Mapping store (MS), automatically uploads DSD file to MS, uploads select statement, creates Mapping set between DSD and Select statement
Textovy slide 8

9. LIVE presentation THANK YOU FOR ATTENTION
Application is accessible on url
Please keep updated on (sign for newsletter)
THANK YOU FOR ATTENTION
Contact :
Tel :
Textovy slide 9