Group members: Phạm Hoàng Long Nguyễn Huy Hùng Lê Minh Hiếu Phan Thị Thanh Thảo Nguyễn Đức Trí 1 BIG DATA & NoSQL Topic 1:

Slides:



Advertisements
Similar presentations
Data Management in the Cloud Paul Szerlip. The rise of data Think about this o For the past two decades, the largest generator of data was humans -- now.
Advertisements

Jennifer Widom NoSQL Systems Overview (as of November 2011 )
Relational Database Alternatives NoSQL. Choosing A Data Model Relational database underpin legacy applications and meet business needs However, companies.
Reporter: Haiping Wang WAMDM Cloud Group
Cassandra Database Project Alireza Haghdoost, Jake Moroshek Computer Science and Engineering University of Minnesota-Twin Cities Nov. 17, 2011 News Presentation:
NoSQL and NewSQL Justin DeBrabant CIS Advanced Systems - Fall 2013.
MongoDB Introduction © Zoran Maksimovic
NoSQL Database.
CS 405G: Introduction to Database Systems 24 NoSQL Reuse some slides of Jennifer Widom Chen Qian University of Kentucky.
Massively Parallel Cloud Data Storage Systems S. Sudarshan IIT Bombay.
Databases with Scalable capabilities Presented by Mike Trischetta.
AN INTRODUCTION TO NOSQL DATABASES Karol Rástočný, Eduard Kuric.
NoSQL for the SQL Server Pro
SQL vs NOSQL Discussion
Systems analysis and design, 6th edition Dennis, wixom, and roth
Getting Biologists off ACID Ryan Verdon 3/13/12. Outline Thesis Idea Specific database Effects of losing ACID What is a NoSQL database Types of NoSQL.
Modern Databases NoSQL and NewSQL Willem Visser RW334.
The Lightning Way XIV Encontro da comunidade SQLPort LX
NoSQL Databases NoSQL Concepts SoftUni Team Technical Trainers Software University
Changwon Nati Univ. ISIE 2001 CSCI5708 NoSQL looks to become the database of the Internet By Lawrence Latif Wed Dec Nhu Nguyen and Phai Hoang CSCI.
NoSQL Databases Oracle - Berkeley DB Rasanjalee DM Smriti J CSC 8711 Instructor: Dr. Raj Sunderraman.
NoSQL Databases Oracle - Berkeley DB. Content A brief intro to NoSQL About Berkeley Db About our application.
Methodological Foundations of Biomedical Informatics (BMSC-GA 4449) Himanshu Grover.
© Copyright 2013 STI INNSBRUCK
When bet365 met Riak and discovered a true, “always on” database.
Copyright © 2015 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill Education.
Logical Database Design Chapter 4 G. Green 1. Agenda Evolution of Data Models Chapter 1 pgs 25 – 28 Chapter 9 pgs 409 – 418 Relational Database Model.
Introduction to MongoDB
NOSQL Implementation and examples Maciej Matuszewski.
Dynamo: Amazon’s Highly Available Key-value Store DAAS – Database as a service.
NoSQL Or Peles. What is NoSQL A collection of various technologies meant to work around RDBMS limitations (mostly performance) Not much of a definition...
NoSQL Systems Motivation. NoSQL: The Name  “SQL” = Traditional relational DBMS  Recognition over past decade or so: Not every data management/analysis.
NOSQL DATABASE Not Only SQL DATABASE
Some notes on NoSQL, in particular MongoDB Bettina Berendt (with thanks to Matthijs van Leeuwen for some of the slides) 8 December 2015.
Grid Technology CERN IT Department CH-1211 Geneva 23 Switzerland t DBCF GT IT Monitoring WG Technology for Storage/Analysis 28 November 2011.
Group : Lê Minh Hi ế u Phan Th ị Thanh Th ả o Ph ạ m Hoàng Long Nguy ễ n Huy Hùng 1 BIG DATA – NoSQL Topic 1.
NoSQL: Graph Databases. Databases Why NoSQL Databases?
Data and Information Systems Laboratory University of Illinois Urbana-Champaign Data Mining Meeting Mar, From SQL to NoSQL Xiao Yu Mar 2012.
NoSQL databases A brief introduction NoSQL databases1.
Big Data Yuan Xue CS 292 Special topics on.
CMPE 226 Database Systems May 3 Class Meeting Department of Computer Engineering San Jose State University Spring 2016 Instructor: Ron Mak
Context Aware RBAC Model For Wearable Devices And NoSQL Databases Amit Bansal Siddharth Pathak Vijendra Rana Vishal Shah Guided By: Dr. Csilla Farkas Associate.
Department of Computer Science, Johns Hopkins University EN Instructor: Randal Burns 24 September 2013 NoSQL Data Models and Systems.
Abstract MarkLogic Database – Only Enterprise NoSQL DB Aashi Rastogi, Sanket V. Patel Department of Computer Science University of Bridgeport, Bridgeport,
1 Analysis on the performance of graph query languages: Comparative study of Cypher, Gremlin and native access in Neo4j Athiq Ahamed, ITIS, TU-Braunschweig.
Dive into NoSQL with Azure Niels Naglé Hylke Peek.
NoSQL: Graph Databases
Neo4j: GRAPH DATABASE 27 March, 2017
2 Phase Commit Protocol In transaction processing, databases, and computer networking, the two-phase commit protocol (2PC) is a type of atomic commitment.
CS 405G: Introduction to Database Systems
NO SQL for SQL DBA Dilip Nayak & Dan Hess.
NoSQL: Graph Databases
and Big Data Storage Systems
CSE 775 – Distributed Objects Bekir Turkkan & Habib Kaya
CS122B: Projects in Databases and Web Applications Winter 2017
Introduction In the computing system (web and business applications), there are enormous data that comes out every day from the web. A large section of.
MongoDB Er. Shiva K. Shrestha ME Computer, NCIT
NoSQL Database and Application
Modern Databases NoSQL and NewSQL
NOSQL.
NOSQL databases and Big Data Storage Systems
NoSQL Systems Overview (as of November 2011).
1 Demand of your DB is changing Presented By: Ashwani Kumar
NOSQL and CAP Theorem.
NoSQL Databases Antonino Virgillito.
Database Systems Summary and Overview
April 13th – Semi-structured data
relational thoughts on NoSql
Introduction to NoSQL Database Systems
NoSQL databases An introduction and comparison between Mongodb and Mysql document store.
Presentation transcript:

Group members: Phạm Hoàng Long Nguyễn Huy Hùng Lê Minh Hiếu Phan Thị Thanh Thảo Nguyễn Đức Trí 1 BIG DATA & NoSQL Topic 1:

Contents  Big Data Introduction Definition Characteristics Advantage and disadvantage of Big Data  NoSQL Definition Database types Characteristics Support NoSQL tools  Take away 2

3 Big Data NoSQL Take away! Following Vice President of Infrastructure Engineering at Facebook: Introduction

Definition 4  Data sets with size belong the ability of commonly used software tools (capture, manage, and process).  Structured, semi-structured and unstructured data.  About Petabytes (PB) and Exabyte (EB) of data. PB = bytes. EB = bytes. Big Data NoSQL Take away!

5 Characteristic  Volume refers to the amount of data.  Variety refers to the number of types of data.  Velocity refers to the speed of data processing. Big Data NoSQL Take away!

6  Variability - refers to the inconsistency which can be shown by the data at times  Veracity - refers to the quality of the data being captured can vary greatly.  Complexity - refers to complex process management data Characteristic (cont.) Big Data NoSQL Take away!

7 Advantages  Flexible schema  Quicker / cheaper to set up  Massive scalability  Eventual consistency => higher performance and availability Disadvantages  No declarative query language => more programming  Eventual consistency => fewer guarantees Advantage and Disadvantage Big Data NoSQL Take away!

8 Definition NoSQL Big Data Take away!  Not only SQL  Used in very large databases.  Non-relational databases.  Mechanism for storage and retrieval of data that is modeled (other than table/key model)  Data structures (e.g. key-value, graph, or document) => some operations faster  Simplicity of design, horizontal scaling, and finer control over availability

9 Characteristics NoSQL Big Data Take away!  Non-relational No more relation  Large volumes of data  Scalable & distribution Spreads data across multiple disks on multiple server  Open source development  Consistency  Improved performance for large data sets Queries need to return answers quickly  Schema-free No schema migrations, code defines your schema.

10 No SQL Database Types Key-values Stores  The simplest type of NoSQL database  Uses key-pair in hash table. A key: unique identifier for some item of data The value: the data that is identified by the key or a pointer to the location of that data  Unique key as pointer to a value.  Logical group of keys are called a “bucket”  E.g.: Amazon DynamoDB, Riak, Windows Azure, Membase and Redis NoSQL Big Data Take away!

11 No SQL Database Types Wide Column Stores  Wide column stores have tables which contains columns  Stores data tables as sections of columns of data  A column family we can have different columns in each row (Super Column Families)  E.g.: Hybertable, SimpleDB NoSQL Big Data Take away!

12 No SQL Database Types Documents  Have databases, collections, and indexes but not joins  Store unstructured (e.g., text) or semi- structured (e.g., XML) documents – basically hierarchical (1 : M)  Documents are addressed in the database via a unique key  Beyond the simple key-document (or key–value) lookup that you can use to retrieve a document  E.g.: MongoDB and CouchDB NoSQL Big Data Take away!

13 No SQL Database Types Graph  Apply graph theory to the storage of information about the relationships between entries  Employ nodes (like entities),properties (attributes), and edges (relationships)  Map more directly to the structure of Object Oriented apps  E.g.: Neo4J and Infinite Graphare NoSQL Big Data Take away!

14 NoSQL Big Data Take away! Tools  Cassandra  CouchDB  Hadoop & Hbase  MongoDB  StupidDB

15 Take away! Big Data NoSQL  What is Big Data? Why?  Characteristics of Big Data.  What is No SQL?  Characteristics of No-SQL  No-SQL Database types

16 Reference  What is Big Data?: Retrieved April 19 th 2015http://en.wikipedia.org/wiki/Big_data  Big Data definition: Retrieved April 19 th 2015http://searchcloudcomputing.techtarget.com/definition/big-data-Big-Data  Big Data characteristics: Retrieved April 19 th 2015http://bigdatahandler.com/2013/10/23/big-data-characteristics-problems-and-solution  What is No-SQL?: Retrieved April 19 th 2015http://en.wikipedia.org/wiki/NoSQL  Document-oriented database: Retrieved April 19 th 2015http://en.wikipedia.org/wiki/Document-oriented_database  Key-Value Store: Retrieved April 19 th 2015http://  Wide Column Stores: Retrieved April 19 th 2015http://bi-bigdata.com/2013/01/13/what-is-wide-column-stores/  Wide Column Stores: Retrieved April 19 th 2015http://bi-bigdata.com/2013/01/13/what-is-wide-column-stores/  Lists 122 NoSQL Databases: Retrieved April 19 th 2015http://

17 Thank for your listening! Question & Answer