Presentation on theme: "Transparent and Flexible Network Management for Big Data Processing in the Cloud Anupam Das Curtis Yu Cristian Lumezanu Yueping Zhang Vishal Singh Guofei."— Presentation transcript:
Transparent and Flexible Network Management for Big Data Processing in the Cloud Anupam Das Curtis Yu Cristian Lumezanu Yueping Zhang Vishal Singh Guofei Jiang
Does the network matter? Link capacity (Mbps)Avg. processing time (min) 10039 5053 (x1.3) 2567 (x1.7) 10146 (x3.7) 4 times slower !!!
Can FlowComb predict transfers? 28% of transfers detected before they start (and 56% before they end)
How quickly can FlowComb change paths? 10%70%20% 60% before transfer midpoint
Can FlowComb reduce processing time? 36% faster than Hadoop without FlowComb (and 28% faster than Hadoop with ECMP)
FlowComb Network management platform for Big Data processing that is transparent to applications and quick and accurate in detecting their demand uses application semantics to detect data transfers (sometimes before they even start)
Your consent to our cookies if you continue to use this website.