Big Data & Test Automation

Slides:

Advertisements

Similar presentations

Syncsort Data Integration Update Summary Helping Data Intensive Organizations Across the Big Data Continuum Hadoop – The Operating System.

Advertisements

Big Data Training Course for IT Professionals Name of course : Big Data Developer Course Duration : 3 days full time including practical sessions Dates.

Paula Ta-Shma, IBM Haifa Research 1 “Advanced Topics on Storage Systems” - Spring 2013, Tel-Aviv University Big Data and.

HBase Presented by Chintamani Siddeshwar Swathi Selvavinayakam

Transform + analyze Visualize + decide Capture + manage Dat a.

DATA WAREHOUSING.

Data Warehousing: Defined and Its Applications Pete Johnson April 2002.

TITLE SLIDE: HEADLINE Presenter name Title, Red Hat Date For Red Hat, it's 1994 all over again Sarangan Rangachari VP and GM, Storage and Big Data Red.

SQL on Hadoop. Todays agenda Introduction Hive – the first SQL approach Data ingestion and data formats Impala – MPP SQL.

Penwell Debug Intel Confidential BRIEF OVERVIEW OF HIVE Jonathan Brauer ESE 380L Feb

Enabling data management in a big data world Craig Soules Garth Goodson Tanya Shastri.

An Introduction to HDInsight June 27 th,

Efficient Processing of Semantic Information on the Web Georg Lausen Technische Fakultät Universität Freiburg.

Introduction to Hbase. Agenda  What is Hbase  About RDBMS  Overview of Hbase  Why Hbase instead of RDBMS  Architecture of Hbase  Hbase interface.

Technology Strategies for the Hospitality Industry© 2005 Pearson Education, Inc Nyheim, McFadden, & Connolly Upper Saddle River, New Jersey Databases.

Hadoop IT Services Hadoop Users Forum CERN October 7 th,2015 CERN IT-D*

Nov 2006 Google released the paper on BigTable.

HEMANTH GOKAVARAPU SANTHOSH KUMAR SAMINATHAN Frequent Word Combinations Mining and Indexing on HBase.

3 DAYS ON JANUARY 16 th, 17 th & 18 th 2015 Santa Clara Convention Center, 5001 Great America Parkway, Santa Clara, CA 95054, United States.

K E Y : DATA SW Service Use Big Data Information Flow SW Tools and Algorithms Transfer Hardware (Storage, Networking, etc.) Big Data Framework Scalable.

Smart Grid Big Data: Automating Analysis of Distribution Systems Steve Pascoe Manager Business Development E&O - NISC.

B ig D ata Analysis for Page Ranking using Map/Reduce R.Renuka, R.Vidhya Priya, III B.Sc., IT, The S.F.R.College for Women, Sivakasi.

Large Scale Semantic Data Integration and Analytics through Cloud: A Case Study in Bioinformatics Tat Thang Parallel and Distributed Computing Centre,

Leverage Big Data With Hadoop Analytics Presentation by Ravi Namboori Visit

Data Analytics Challenges Some faults cannot be avoided Decrease the availability for running physics Preventive maintenance is not enough Does not take.

1 Gaurav Kohli Xebia Breaking with DBMS and Dating with Relational Hbase.

Hadoop Introduction. Audience Introduction of students – Name – Years of experience – Background – Do you know Java? – Do you know linux? – Any exposure.

Big Data-An Analysis. Big Data: A definition Big data is a collection of data sets so large and complex that it becomes difficult.

Hadoop Big Data Usability Tools and Methods. On the subject of massive data analytics, usability is simply as crucial as performance. Right here are three.

Building a Data Warehouse

OMOP CDM on Hadoop Reference Architecture

SQL Server Analysis Services Fundamentals

Big Data, Data Mining, Tools

SNS COLLEGE OF TECHNOLOGY

SAS users meeting in Halifax

5/7/ :44 AM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN.

Sushant Ahuja, Cassio Cristovao, Sameep Mohta

Hadoop and Analytics at CERN IT

Integrating QlikView with MPP data sources

INTRODUCTION TO PIG, HIVE, HBASE and ZOOKEEPER

Support digital applications with a resilient, highly available and NRT Hadoop Backend Santander UK.

Institute for Cyber Security

Chapter 14 Big Data Analytics and NoSQL

Hadoop Developer.

Big Data Technology.

CLOUDERA TRAINING For Apache HBase

Enabling Scalable and HA Ingestion and Real-Time Big Data Insights for the Enterprise OCJUG, 2014.

Journey of Quality Analysts towards Data Analytics

07 | Analyzing Big Data with Excel

Visual Analytics Sandbox

AUDIT AND VALIDATION TESTING FOR BIG DATA APPLICATIONS

Big Data - in Performance Engineering

Introduction to PIG, HIVE, HBASE & ZOOKEEPER

Hadoop for SQL Server Pros

Introduction to Apache

Databases Chapter 9 Technology Strategies for the Hospitality Industry © 2005 Pearson Education, Inc Nyheim, McFadden, & Connolly.

Overview of big data tools

Zoie Barrett and Brian Lam

Charles Tappert Seidenberg School of CSIS, Pace University

Applying Data Warehousing and Big Data Techniques to Analyze Internet Performance Thiago Barbosa, Renan Souza, Sérgio Serra, Maria Luiza and Roger Cottrell.

Dep. of Information Technology By: Raz Dara Mohammad Amin

Big-Data Analytics with Azure HDInsight

Analysis of Structured or Semi-structured Data on a Hadoop Cluster

UNIT 6 RECENT TRENDS.

Pig Hive HBase Zookeeper

Presentation transcript:

Big Data & Test Automation

Agenda What is Big Data? Big Data architecture Big Data technologies Testing strategy Functional test automation on data warehousing

What is Big Data Is it just huge amount of data ?

What is Big Data

Why do we need Big Data For Effective marketing To make better business decision To gather customer feedback Attain customer satisfaction Increase revenue

Why do we need Big Data

4 V’s of Big Data

Big Data Architecture

HDFS( Hadoop Distributed File System) Big Data Technologies HDFS( Hadoop Distributed File System)

Big Data Technologies Map Reduce – Framework Map - Perform filtering and sorting on data sets Reduce - Perform summary operation on map step result Hbase HBase is a column-oriented database management system Hive Data warehousing infrastructure for Hadoop. Data summarization, query and analysis Pig To create MapReduce programs used with Hadoop

Big Data Ecosystem Testing Big Data Extraction Testing Test Strategy Big Data Ecosystem Testing Big Data Extraction Testing Pre-Hadoop Validation Meta Data Analysis and Validation Impala & HDFS Data Storage Validation Validation on Data Extraction from Source Referential Integrity & Constraint Validation Heterogeneous Data Integration Validation Big Data Ecosystem Testing Non Functional Testing Big Data Testing Big Data Extraction Testing Data Transformation /Migration Testing Data Analytics and Visualization Testing Data Transformation/Migration Testing Data Quality Validation Data Correctness/ Completeness Validation Business Rule Validation Big Data Tools Query Surge - Functional Data analytics and Visualization Testing HDFS to SSAS validation Dashboard Validation Visualization Validation Report generation and Validation Non Functional Testing Performance Validation Security Validation

Query Surge Tool

Conclusion

Thank You