1. Rome - 24 January 2014 1 Earth Server EU FP7-INFRA project 283610 Scalability for Big Data Roberto Barbera - University of Catania and INFN - Italy (roberto.barbera@ct.infn.it)roberto.barbera@ct.infn.it Rome - 24 January 2014

2. 2 Earth Server EU FP7-INFRA project 283610 Big Data infrastructures’ layout v v [1] (*) EC Directorate General CNECT - Directorate C: Excellence in Science - Unit C1 – e-Infrastructures – «Research Data e-Infrastructures: Framework for Action in H2020”

3. Rome - 24 January 2014 3 Earth Server EU FP7-INFRA project 283610 Time Common Data Services - Evolution of distributed computing and storage Mainframe Computing 80’s-90’s Cluster Computing 90’s-00’s Grid Computing (e.g., EGI) Cost of hw Cost of networks Power of COTS WAN bandwidth 00’s-10’s Cloud Computing (e.g., EGI FedCloud) A Big Data e-Infrastructure ready for H2020 should be standard-based, scalable, computing-model-agnostic and interoperable

4. Combine everything together and get a new buzzword: Jungle Computing (*) (*) B. Kahanwal and T. P. Singh, “The Distributed Computing Paradigms: P2P, Grid, Cluster, Cloud, and Jungle”, International Journal of Latest Research in Science and Technology, Vol. 1, Issue 2, Page 183-187, July-August (2012), ISSN (Online):2278-5299, www.mnkjournals.com/ijlrst.htmwww.mnkjournals.com/ijlrst.htm 4

5. Rome - 24 January 2014 5 Earth Server EU FP7-INFRA project 283610 Scalability A pertinent definition: ◦ ” In electronics (including hardware, communication and software), scalability is the ability of a system, network, or process to handle a growing amount of work in a capable manner or its ability to be enlarged to accommodate that growth ” [1] …and several implementations: ◦ Scalability across infrastructure models ◦ Scalability of software ◦ Scalability of potential users ◦ Scalability across data types and clients ◦ Scalability across platforms ◦ Scalability across services and standards [1] Bondi, André B. (2000), "Characteristics of scalability and their impact on performance“, Proceedings of the second international workshop on Software and performance – WOSP '00. p. 195, doi:10.1145/350391.350432, ISBN 158113195X.

6. Scalability of potential users: Science Gateways

7. Scalability of potential users: Identity Federations

8. Scalability across infrastructure models 15

9. Scalability across platforms Cloud FedCloud IT ES EG ZA CZ GR 8 clouds 6 countries 3 m/w stacks 1 SME

10. Current functionalities: Federated authentication Fine-grained authorisation Single/multi-deployment of VMs on a cloud and across clouds Single/multi-move of VMs across clouds Single/multi-deletion of VMs on a cloud and across clouds SSH connection to VMs Direct web access to VMs hosting web services Scalability across platforms

11. Rome - 24 January 2014 11 Earth Server EU FP7-INFRA project 283610 Fine grained authorisation

12. Rome - 24 January 2014 12 Earth Server EU FP7-INFRA project 283610 Scalability across services and standards

13. Rome - 24 January 2014 13 Earth Server EU FP7-INFRA project 283610 Scalability across infrastructure models and clients eToken service Front-ends glibrary.ct.infn.it REST API AuthN / AuthZ Science Gateway User Tracking DB Call gLibrary REST API through API Server Gateway Metadata Service Local storage Grid storage Cloud Storage Authorization service Authentication service

14. Rome - 24 January 2014 14 Earth Server EU FP7-INFRA project 283610 Scalability across data types and e-infrastructure models – the ESA MERIS repository

15. Rome - 24 January 2014 15 Earth Server EU FP7-INFRA project 283610 Scalability across data types and clients – the unified mobile client glibrary.ct.infn.it REST API AuthN / AuthZ Unified mobile client Local storage Grid storage Cloud Storage Authorization service Authentication service Provider’s storage …

16. Rome - 24 January 2014 16 Earth Server EU FP7-INFRA project 283610 Scalability across platforms (using Appcelerator Titanium)

17. Rome - 24 January 2014 17 Earth Server EU FP7-INFRA project 283610 Unified view of repositories Hierarchical filtering

18. Rome - 24 January 2014 18 Earth Server EU FP7-INFRA project 283610 Browse & download

19. 10 The eCSG Mobile «in action» (data browsing and download)