Big Data – Big Opportunity Mohammad Khansari ITRC President Jan 2015 ITRC, Tehran, Iran

Big Data: Definition Definition:  Big Data associates with the rapidly growing Structured and Unstructured datasets with sizes beyond the ability of conventional database tools to store, manage or analyze them. پژوهشگاه ارتباطات و فناوری اطلاعات 2 Source: McKinsey

Big data: Opportunities for Iran Big data market is 25 billion dollar annually!  India is trying to capture 1 billion of this market!  Can we have some portion of it? North America & Europe host over 85% of the world’s data!  Can we host and therefore offer services in the region? Supporting startups in the domain of:  Big data analytics tools  Big data storage management (db, etc.)  Big data application development  Big data services What will happen to our own generated big data? پژوهشگاه ارتباطات و فناوری اطلاعات 3

Velocity & Volume پژوهشگاه ارتباطات و فناوری اطلاعات 4 Source: Intel [2013] video

Big Data Goal: Advanced Analytics پژوهشگاه ارتباطات و فناوری اطلاعات 5 Descriptive analytics Evolution of analytics Complexity Time Standard reports Adhoc reports Alerts Statistical analysis Forecasting Predictive modeling Optimization Stochastic optimization Natural Language Processing Big Data analytics Complex event processing Predictive analytics Prescriptive analytics Basic analytics  What happened?  When did it happen?  What was the its impact ? Multivariate statistical analysis Time series analysis Behavioral analytics Constraint based BI Social network analytics Semantic analytics Online analytical processing (OLAP) Extreme SQL Visualization Analytic database functions Late 1990s2000 Query drill down Source: CRISIL

Applications to Society Source: IBM [2014], Vivante پژوهشگاه ارتباطات و فناوری اطلاعات 6

Emerging Research Fields (1) Network Science Knowledge Engineering and data science Decision Science Signal processing for big data e-science: database - centric computing in science Computational Social Science!  Predict the behavior, the trend and the future actions of a society, with respect to many variables, based on advanced analytics!

Emerging Research Fields (2) پژوهشگاه ارتباطات و فناوری اطلاعات 8

Human Resource Challenge The biggest challenge: Talent shortage! پژوهشگاه ارتباطات و فناوری اطلاعات 9 50%-60% gap relative to supply 300K 140K – 190K 440K-490K Source: McKinsey 60% gap relative to supply 2.5 million 1.5 million 4.0 million

THANKS پژوهشگاه ارتباطات و فناوری اطلاعات 10

Big Data: Variety پژوهشگاه ارتباطات و فناوری اطلاعات 11 Structured Data  Accounts for ~ 20% of the total data existing currently! AudioVideoBlogsLocationsText message RDBMS, ERPData Warehousing Unstructured Data  Accounts for ~ 80% of the total data existing currently! Social mediaGeospatialSensor data  Extract meaningful analysis from this data:  NoSQL  Hadoop  Massive Parallel Processing (MPP)  Extract meaningful analysis from this data:  NoSQL  Hadoop  Massive Parallel Processing (MPP)

Big Data Enabler: The Infrastructure Challenges Technology needs:  High Performance  Low Energy Source: Smarter Computing, Alliance Trust Investments پژوهشگاه ارتباطات و فناوری اطلاعات 12

Privacy: A Key Issue! Source: IBM پژوهشگاه ارتباطات و فناوری اطلاعات 13

Big Data Enabler: The Infrastructure پژوهشگاه ارتباطات و فناوری اطلاعات 14

FinanceHealth Care Big Data: Early Industry Adopters پژوهشگاه ارتباطات و فناوری اطلاعات 15 BankingTradingInsurance Trading surveillance Intraday analysis Trading pattern analysis Credit optimization Predict client longevity, along with analyzing perspective medical status, weather conditions, etc. Fraud detection Portfolio analytics Risk assessment Health Care Faster diagnosis and drug releases Personalized Medicine: Effective drugs for specific population, region, ethnicity, etc. Personalized Medicine: Effective drugs for specific population, region, ethnicity, etc. Cost effective healthcare through better diagnosis and more effective drugs Cancer detection Population analytics Risk assessment