به نام خدا Big Data and a New Look at Communication Networks Babak Khalaj Sharif University of Technology Department of Electrical Engineering.

Slides:



Advertisements
Similar presentations
Designing Services for Grid-based Knowledge Discovery A. Congiusta, A. Pugliese, Domenico Talia, P. Trunfio DEIS University of Calabria ITALY
Advertisements

The role of virtualisation in the dense wireless networks of the future Sokol Kosta CINI.
Large Scale Computing Systems
Making Cellular Networks Scalable and Flexible Li Erran Li Bell Labs, Alcatel-Lucent Joint work with collaborators at university of Michigan, Princeton,
OVERVIEW OF NETWORKING RESEARCH IN NETLAB 1 Dr. Jim Martin Associate Professor School of Computing Clemson University
The Meraka Indoor wireless mesh test bed A new multi hop routing benchmarking tool David Johnson Senior Researcher Wireless Africa Programme Meraka CSIR.
1© Copyright 2015 EMC Corporation. All rights reserved. SDN INTELLIGENT NETWORKING IMPLICATIONS FOR END-TO-END INTERNETWORKING Simone Mangiante Senior.
Project Results Colin Willcock, Project Coordinator for SEMAFOUR Project.
Bioinformatics Protein structure prediction Motif finding Clustering techniques in bioinformatics Sequence alignment and comparison Phylogeny Applying.
Data Mining on the Web via Cloud Computing COMS E6125 Web Enhanced Information Management Presented By Hemanth Murthy.
Cloud computing is the use of computing resources (hardware and software) that are delivered as a service over the Internet. Cloud is the metaphor for.
Tennessee Technological University1 The Scientific Importance of Big Data Xia Li Tennessee Technological University.
COLUMBIA UNIVERSITY Department of Electrical Engineering The Fu Foundation School of Engineering and Applied Science IN THE CITY OF NEW YORK Networking.
IE 585 Introduction to Neural Networks. 2 Modeling Continuum Unarticulated Wisdom Articulated Qualitative Models Theoretic (First Principles) Models Empirical.
1 1 Slide Introduction to Data Mining and Business Intelligence.
Heterogeneous network - How do mobile operators exploit different network together to enhance customer satisfaction and reduce operating cost. Yao-Yu Li,
Ran aware flow control tool
ECE 4450:427/527 - Computer Networks Spring 2015 Dr. Nghi Tran Department of Electrical & Computer Engineering Lecture 2: Overview of Computer Network.
Service - Oriented Middleware for Distributed Data Mining on the Grid ,劉妘鑏 Antonio C., Domenico T., and Paolo T. Journal of Parallel and Distributed.
Research Interest overview and future directions Mina Guirguis Computer Science Department Texas State University – San Marcos CS5300 9/16/2011.
THE VISION OF AUTONOMIC COMPUTING. WHAT IS AUTONOMIC COMPUTING ? “ Autonomic Computing refers to computing infrastructure that adapts (automatically)
Internet of Things. IoT Novel paradigm – Rapidly gaining ground in the wireless scenario Basic idea – Pervasive presence around us a variety of things.
Internet of Things in Industries
CISC 849 : Applications in Fintech Namami Shukla Dept of Computer & Information Sciences University of Delaware iCARE : A Framework for Big Data Based.
Leveraging SDN for The 5G Networks: Trends, Prospects and Challenges ADVISOR: 林甫俊教授 Presenter: Jimmy DATE: 2016/3/21 1.
SDN/NFV DDoS Requirements "The Mobile Use Case – 5G" Bipin Mistry, VP Product Management © 2015 Corero
Automating Wireless IP Network And Virtualized Mobile Core Functions HetnetIP: Wireless IP Backhaul Management Automation and Multi-tenant Portal.
ScotGRID is the Scottish prototype Tier 2 Centre for LHCb and ATLAS computing resources. It uses a novel distributed architecture and cutting-edge technology,
Information Systems and Technologies in Organizations.
Communication Protocol Engineering Lab. A Survey Of Converging Solutions For Heterogeneous Mobile IEEE Wireless Communication Magazine December 2014 Minho.
Internet of Things (IoT) Market Shares, Strategies, and Forecasts, Worldwide, 2017 to 2023 Published: Mar 2017 Single User PDF: US$ 4200 Order this report.
Introduction to Machine Learning, its potential usage in network area,
Data Analytics (CS40003) Introduction to Data Lecture #1
SDN & NFV Driving Additional Value into Managed Services.
Grid Wide IoT Gateway Supports open standards and technologies, with open interfaces that provide support for proprietary gas-meter reading protocols and.
INTRODUCTION TO WIRELESS SENSOR NETWORKS
Internet of Things Approach to Cloud-Based Smart Car Parking
Main Research Areas Signal Processing and Communications
5G MOBILE TECHNOLOGY TECHNICAL SEMINAR
“An Eye View On the Future Generation Of Phones”
DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING CLOUD COMPUTING
Integrated Energy and Spectrum Harvesting for 5G Wireless Communications submitted by –SUMITH.MS(1KI12CS089) Guided by – BANUSHRI.S(ASST.PROF,Dept.Of.CSE)
Clouds , Grids and Clusters
TECHNOLOGY GUIDE THREE
Dan Bieler, Principal Analyst
Internet of Things and its applications
1st Draft for Defining IoT (1)
Future Technologies FTC 2016 Future Technologies Conference December 2016 San Francisco, United States.
Algorithms for Big Data Delivery over the Internet of Things
Nortel Corporate Presentation
An Overview of the ITTC Networking & Distributed Systems Laboratory
Intelligent 5G Networks Managing 5G Wireless/Mobile Broadband
TECHNOLOGY GUIDE THREE
High Intelligent Network (Smart Pipe)
Mobile edge computing Report by Weiqing huang.
ECE 4450:427/527 - Computer Networks Spring 2017
Data Warehousing and Data Mining
Ch 4. The Evolution of Analytic Scalability
C.U.SHAH COLLEGE OF ENG. & TECH.
Speaker: Jin-Wei Lin Advisor: Dr. Ho-Ting Wu
Smart Learning concepts to enhance SMART Universities in Africa
Aijun Wang China Telecom Nov 2017
Web Mining Department of Computer Science and Engg.
GATES: A Grid-Based Middleware for Processing Distributed Data Streams
Resource Allocation in a Middleware for Streaming Data
Big DATA.
Panel on Research Challenges in Big Data
The Intelligent Enterprise and SAP Business One
TECHNOLOGY GUIDE THREE
L. Glimcher, R. Jin, G. Agrawal Presented by: Leo Glimcher
Presentation transcript:

به نام خدا Big Data and a New Look at Communication Networks Babak Khalaj Sharif University of Technology Department of Electrical Engineering

Big Data Trend.. Explosive Growth of Data: from terabytes to petabytes Lot of information “hidden” in the data that is not readily evident and is never analyzed Wide range: Traditional: Web (Google, Amazon,…), e-commerce… Science: Remote sensing, bioinformatics, scientific simulation, … Smart Grids Telecom Operator databases Our focus is on exploiting Big Data in a new front: “Communication Networks” 2 Sharif University of Technology

Mobile Operators view: Financial side Segments addressed so far through Big Data: Optimizing and monetizing mobile data Mobile data fraud and revenue assurance Approaches: Statistical data summarization and feature extraction Clustering in high dimensional spaces 3 Sharif University of Technology

Can we further expand the Big Data view in performance side? Key question: Does “big data” knowledge really help in hierarchical structures? Large part of our knowledge in such networks is “local” Already tried to depart from a central structure and moved toward “distributed” algorithms It seems “big data” is not really aligned with such direction! So, lets revisit our view of future mobile networks.. 4 Sharif University of Technology

Future Network View Cloud processing architecture IoT and large number of nodes and resource sharing options Dumber nodes and more central control 5 Sharif University of Technology

Physical Distribution: RRH and Cloud-RAN Digital Unit (DU) pooling Joint processing through CoMP, joint scheduling and joint interference alignment/cancellation Optimization not just at wireless level any more (includes fiber backbone as well) 6 Sharif University of Technology

Alignment of Telecoms and IT Software Defined Networking (SDN): APIs (application programming interfaces) used for network configuration Network Function Virtualization (NFV): Commodity hardware is used to run networking functions in software 7 Sharif University of Technology

Vision of BD in Communication Networks Issues to note in our analytics view: Growth of mobile broadband Enhanced connectivity and adoption of M2M Power of cloud computing Easy and cheaper access to big data technologies Can not store all data in a large database and run offline queries on top Achieving real-time and predictive analytics 8 Sharif University of Technology

Big Data in Communication Networks Large communication networks always dealt with “Big Data” Channel state over a wireless network coverage area Users usage patterns and context information User data transported by the network Data generated by network elements Million Dollar Question: Ignoring the complexity for now, can we exploit big data to improve network performance and reduce operator costs? 9 Sharif University of Technology

Back to Future View: SON side Self Organizing Networks (SON): SON makes more sense as we also combine it with Big Data: Big data to make networking smarter is just the beginning of what the explosive growth in information is going to provide in terms of efficiency. Cognitive view of wireless networks now goes far beyond just frequency sensing/utilization Mobile data traffic explosion-> operators must „densify“ their network (HetNets) SON is key For HetNets (Traffic Steering: making the resources appear as “one network”) 10 Sharif University of Technology

SON Functionalities 11 Sharif University of Technology

Big Data and Network Optimization 12 Sharif University of Technology

Back to the other side of the coin.. So, clouds now provide new path in processing large amounts of data Need for a new look at how we design, operate and optimize our hierarchical networks: Local: Select and gather information Local-Global information exchange Global: Process information Global-Local: Send back action plans 13 Sharif University of Technology

Issues to consider: Privacy issues for access to Big Data Probing: Practicality of access to Big Data distributed over network with nodes that can not extract local data LTE has the standards for data interfaces but this is not true for GSM or 3G and small cells.  14 Sharif University of Technology

3 Key Aspects of Big Data Analytics Machine Learning Statistics Graph Analysis and Signal Processing Big Data Database Systems and Parallel Processing 15 Sharif University of Technology

First Step to Address Big Data: Partitioning Identify Sources of Big Data: Information Sources and/or Network States Extract the Information Machine Learning View Signal Processing View Exploit the Information through proper actions 16 Sharif University of Technology

I. Identify the Source/Network State At what “scale” to look at data? Macro vs. Micro view How to sample data? Sampling domain, type and rate 17 Sharif University of Technology

II. Extract Machine Learning view Behavior mining: user, packet, network levels Signal Processing view Network Signal Processing and Adaptive Networking 18 Sharif University of Technology

III. Exploit Smart Resource Allocation Smart Handovers between Hetnets Policy and Charging Engines 19 Sharif University of Technology

Conclusion Access to Big Data inevitable in future communication networks (fixed and mobile) More centralized processing through different levels of cloud computing Business Intelligence goes beyond financial benefits to technical benefits How to accommodate big data in real-time remains a big challenge.. 20 Sharif University of Technology

Thanks! 21 Sharif University of Technology