2. Budget JRA2 Beneficiaries Description TOT Costs incl travel
PSI (leader)
32 PM
330 k€
ESRF (co-leader)
30 PM
255 k€
DESY
14 PM
108 k€
DLS
12 PM
95 k€
CELLS
51 k€
Elettra
61 k€
TOT (incl. 25% indirect costs)
900 k€

3. Objectives and structure of JRA 2 -1
Build up demonstrators for remote data analysis for a small number of archetypal experiments.
The demonstrators will build on the HPC platforms of each participating institute. It will be cloud based in those institutes where cloud technology is deployed. In the other institutes it will run on standard HPC hardware.
A web portal will ensure users to have a common user experience.

4. Objectives and structure JRA2 -2
Make an assembly of integrated and deployable data analysis applications to help the users to rapidly analyse and publish their data.
Implementation of these applications as deployable meta-packages, as pre-configured virtual machines or as containers.
Virtual machines or containers provide encapsulated user environments, which can be archived together with the experimental data.
Capturing valuable provenance data and strongly supporting reproducibility of the original experiment and data analysis workflows.

5. Objectives and structure JRA2 -3
For remote data analysis, the system will provide access through a user portal implementing a standard authentication system (building on the UMBRELLA system realised through the PaNdata and CRISP FP7 projects) for secure access.
The Umbrella attribute authority will be extended to allow users to add required attributes in a self-service way.
The environment will provide efficient access to data storage for accessing raw data and storing results.
Users will login in to a portal and seamlessly access the compute and storage resources.

6. PaNDaaS architecture

7. Tasks JRA2
(T1) Design a platform which satisfies the requirements for Remote Data Analysis as a Service. The design will take into account the current situation at the partner institutes. Study approaches which increase re-usability of solutions like component based software engineering and development of scientific/algorithmic libraries. Evaluate different container concepts as deployment strategies, like classical installation procedures, shipping of virtual machines and/or Docker containers. (18M)

8. Tasks JRA2
(T2) Collect and compare offline (post experiment) data analysis requirements and existing software solutions from users of at least 3 different sites. Analyse which of these use cases and/or solutions are suitable candidates for providing harmonised solutions which can be transferred from one site to another site. Do this for the use case domains selected i.e. SAXS, Tomography, Diffraction (including MX) (8M)
(T3) Implement DaaS on the local platform at the each site with remote access to compute and storage resources using dedicated hardware resources supplied by each site (23M)
(T4) Design and implement Remote Data Analysis as a Service portal demonstrator (16M)

9. Tasks JRA2
(T5) Package and deploy data analysis packages for at least two Use Cases / site (20M)
(T6) Extend and deploy the Umbrella authentication system as the standard authentication mechanism to fully support different non-web-based authentication mechanisms to be able to service a broader range of facilities (eduGain + JISC Assent) with differing needs and capabilities. (18M)
(T7) Test data analysis software for Use Cases with test data and users (6M)

10. Deliverables JRA2
(D1) Kickoff workshop for the CALIPSOplus partners to present their needs for remote data analysis (M3).
(D2) Blueprint on implementing a platform and manuals for the implementation at the different sites (M12).
(D3) Cross site use case requirement report including comparison of existing solutions. (M12)
(D4) Software packages for the selected experiment use cases ready to install and run (M18)
(D5) Report on test and deployment of mini demonstrator on at least six sites (M24)

11. Deliverables JRA2
(D6) White paper on suitability of HNScienceCloud and European Open Science Cloud for synchrotron and FEL applications (M36)
(D7) Organise a workshop and present the white paper on data analysis needs of the light source user community to the European Synchrotron user organization ESUO (M36).(D1) Position paper on Open Science Cloud and the light source community (M6)

12. Wir schaffen Wissen – heute für morgen
Thank you for your attention!