1. NO-SQL Mr. Namdeo Badhe

2. Schema BE ( Information Technology )T.E. SEM: V Course Name: No SQLCourse Code: PEC-IT 5012 Teaching Scheme (Program Specific)Examination Scheme (Formative/ Summative) Modes of Teaching / Learning / WeightageModes of Continuous Assessment / Evaluation Hours Per Week Theory (100) Practical/Oral (25) Term Work (25) Total TheoryTutorialPractical Contact Hours CreditsISEIEESEORTW 150 3-2@5420 6025 ISE: In-Semester Examination - Paper Duration – 1 Hour IE: Innovative Examination ESE: End Semester Examination - Paper Duration - 2 Hours Total weightage of marks for continuous evaluation of Term work/Report: Formative (40%), Timely Completion of Practical (40%) and Attendance /Learning Attitude (20%). @ Castone Project Prerequisite: Database management system, Data structures.

3. Course Objective This course intends to learn basics of NoSQL databases, architecture patterns, implementation of NoSQL database based on business requirements.

4. Course Outcomes Upon completion of the course students will be able to: – Compare and Contrast NoSQL databases with each other and Relational Database Systems. – Demonstrate an understanding of the detailed architecture, define objects, load data, query data and performance tune document-oriented NoSQL databases. – Explain the detailed architecture; define objects, load data, query data and performance tune Column -oriented NoSQL databases. – Demonstrate an understanding of the detailed architecture; define objects, load data, query data and performance tune Key-Value Pair and Graph NoSQL databases. – Understand the concept and challenge of big data and how NoSQL provides different ways to handle it. – Develop web application with NoSQL &Perform basic database administration tasks.

5. Syllabus

6. Lets Revise… What is SQL? What Can SQL do? What is SQL Database? Different Types of Database ? Different Software for DBMS

7. SQL Databases SQL databases are relational. SQL databases use structured query language and have a predefined schema. SQL databases are vertically scalable SQL databases are table based. SQL databases are better for multi-row transactions.

8. How does the SQL database (relational database) work? Example :A simple book database

9. Lets Revise… What is SQL? What Can SQL do? What is SQL Database? Different Types of Database ? Different Software for DBMS ?

11. Index What is NoSQL database? Types of NoSQL Databases ? Different Types of NoSQL Databases ? Different Software for NoSQL Databases ? SQL Database vs NoSQL Databases Challenges of SQL Databases and how NoSQL Databases mitigates it? Real Time Applications of NoSQL Database?

12. What is NoSQL database ? NoSQL stands for “non SQL” “not only SQL” NoSQL database => Non-Relational Database means, that does not require a fixed schema, avoids joins, and is easy to scale. NoSQL is used for Big data and real-time web apps. For example, companies like Twitter, Facebook, Google collect terabytes of user data every single day.

13. Types of NoSQL Databases

15. SQL Database vs NoSQL Databases SQL DatabasesNoSQL Databases SQL Databases are categorized as Relational Database Management System (RDBMS). NoSQL databases are categorized as Non- relational or distributed database system.

16. SQL Database vs NoSQL Databases SQL DatabasesNoSQL Databases SQL Databases are categorized as Relational Database Management System (RDBMS). NoSQL databases are categorized as Non- relational or distributed database system. SQL databases have fixed or static or predefined schema. NoSQL databases have dynamic schema.

17. SQL Database vs NoSQL Databases SQL DatabasesNoSQL Databases SQL databases display data in form of tables so it is known as table-based database. NoSQL databases display data as collection of key-value pair, documents, graph databases or wide-column stores. SQL databases have fixed or static or predefined schema. NoSQL databases have dynamic schema. SQL databases display data in form of tables so it is known as table-based database. NoSQL databases display data as collection of key-value pair, documents, graph databases or wide-column stores.

18. SQL Database vs NoSQL Databases SQL DatabasesNoSQL Databases SQL databases are vertically scalable.NoSQL databases are horizontally scalable.

19. SQL Database vs NoSQL Databases SQL DatabasesNoSQL Databases SQL databases are vertically scalable.NoSQL databases are horizontally scalable. SQL databases use a powerful language "Structured Query Language" to define and manipulate the data. In NoSQL databases, collection of documents are used to query the data. It is also called unstructured query language. It varies from database to database.

20. SQL Database vs NoSQL Databases SQL DatabasesNoSQL Databases SQL databases are vertically scalable.NoSQL databases are horizontally scalable. SQL databases use a powerful language "Structured Query Language" to define and manipulate the data. In NoSQL databases, collection of documents are used to query the data. It is also called unstructured query language. It varies from database to database. SQL databases are best suited for complex queries.NoSQL databases are not so good for complex queries because these are not as powerful as SQL queries. MySQL, Oracle, Sqlite, PostgreSQL and MS-SQL etc. are the example of SQL database. MongoDB, BigTable, Redis, RavenDB, Cassandra, Hbase, Neo4j, CouchDB etc. are the example of nosql database

21. Challenges of SQL DatabasesHow NoSQL mitigates the challenges Do not scale well to massive data sets and transaction rates. RDBMS does not scale out easily on commodity clusters. cannot scale out to multiple inexpensive server nodes only up to bigger more expensive hardware ELASTIC SCALING NoSQL databases are flexible and scalable, and also have superior performance. while NoSQL can expand transparently to take advantage of new nodes, thus substantially reducing commodity hardware costs.

22. Challenges of SQL Database/RDBMS How NoSQL mitigates the challenges of RDBMS Do not play well in a cloud environment SIZABLE DATA While it is becoming impossible for RDBMS to handle tremendously growing databases, NoSQL systems are capable to handle large volumes of data such as Hadoop.

23. Challenges of SQL Database/RDBMS How NoSQL mitigates the challenges of RDBMS cannot handle semi-structured data/ unstructured data NoSQL database can be easily handle semi- structured data/ unstructured data

24. Structured vs Semi-structured vs Unstructured data

25. Challenges of SQL Database/RDBMS How NoSQL mitigates the challenges of RDBMS cannot cope with changing or fuzzy schema specifications and it is costly/impossible/slow to manage schema change FLEXIBLE DATA MODELS With RDBMS, change management is a real problem as even the smallest changes need to be aptly managed else service levels will be compromised. On the other hand, due to its fewer restrictions, rigidly defined Big Table- based NoSQL database can be easily used for the creation of new columns.

26. Challenges of SQL Database/RDBMS How NoSQL mitigates the challenges of RDBMS SQL database are not suited for real time analytics NoSQL databases, in general, avoid RDBMS functions such as multi-table joins that can result in high latency. NoSQL offers choices of strict to no relaxed consistency that one needs to look on individual case basis. NoSQL setting is better suited to real time analytics and also when data is brought together from any upstream system to build an application. BI-tool support for NoSQL is growing steadily.

27. Real Time Applications of NoSQL Database? Fraud detection and identity authentication Inventory and catalog management Mobile Applications(Kobo and Playtika) Personalization, recommendations and customer experience Internet of things (IoT) and sensor data E-Commerce(E-Bay,Snapdeal) Financial services and payments Ad Targeting(AOL, Mediamind and PayPal) Logistics and asset management Content management systems Digital and media management Social Gaming(electronic arts, zynga and tencent.)

28. Which companies use SQL and NoSQL? SQL DatabaseNoSQL database Microsoft NTT Data Cognizant Dell Accenture Stack Overflow Amazon Adobe Capgemini SAP Qualcomm J.P. Morgan

29. Machine Learning with NoSQL? NoSql is a non relational DB whereas ML is art of playing with data to get some analytics or forecasts. We can always use NoSql DB to store the data we use for ML. But its not mandatory that NoSql is must for ML. Top Databases Used In Machine Learning Projects (analyticsindiamag.com) Top Databases Used In Machine Learning Projects (analyticsindiamag.com)

30. Why NoSQL databases are chosen over RDBMS in Machine Learning Highly and Easily Scalable Dynamic Schema or Flexible Data model Less Expensive to maintain Transaction Speed Cloud Computing

31. Any Questions

32. Features of NoSQL Non-relational: – NoSQL databases never follow the relational model – Never provide tables with flat fixed-column records – Work with self-contained aggregates or BLOBs – Doesn't require object-relational mapping and data normalization – No complex features like query languages, query planners,referential integrity joins, ACID

33. Features of NoSQL Schema-free – NoSQL databases are either schema-free or have relaxed schemas – Do not require any sort of definition of the schema of the data – Offers heterogeneous structures of data in the same domain

34. Features of NoSQL-Schema-free

35. Features of NoSQL Simple API – Offers easy to use interfaces for storage and querying data provided – APIs allow low-level data manipulation & selection methods – Text-based protocols mostly used with HTTP REST with JSON – Mostly used no standard based query language – Web-enabled databases running as internet-facing services

36. Features of NoSQL Distributed – Multiple NoSQL databases can be executed in a distributed fashion – Offers auto-scaling and fail-over capabilities – Often ACID concept can be sacrificed for scalability and throughput – Mostly no synchronous replication between distributed nodes Asynchronous Multi-Master Replication, peer-to-peer, HDFS Replication – Only providing eventual consistency – Shared Nothing Architecture. This enables less coordination and higher distribution.

37. Features of NoSQL- Shared Nothing Architecture

38. what is NoSQL? In short – It’s more than rows in tables – It’s free of joins – It’s schema-free – It works on many processors – It uses shared-nothing commodity computers – It supports linear scalability – It’s innovative

39. what NoSQL is not? It’s not about the SQL language It’s not only open source It’s not only big data It’s not about cloud computing It’s not about a clever use of RAM and SSD It’s not an elite group of products

40. How does the NoSQL database (non-relational database) work? Example :A simple book database

41. How does the NoSQL database (non-relational database) work? Example :A simple book database in JSON

42. Advantages of NoSQL Can be used as Primary or Analytic Data Source Big Data Capability No Single Point of Failure Easy Replication No Need for Separate Caching Layer It provides fast performance and horizontal scalability. Can handle structured, semi-structured, and unstructured data with equal effect

43. Advantages of NoSQL Object-oriented programming which is easy to use and flexible NoSQL databases don't need a dedicated high-performance server Support Key Developer Languages and Platforms Simple to implement than using RDBMS It can serve as the primary data source for online applications. Handles big data which manages data velocity, variety, volume, and complexity Excels at distributed database and multi-data center operations Eliminates the need for a specific caching layer to store data Offers a flexible schema design which can easily be altered without downtime or service disruption

44. Disadvantages of NoSQL No standardization rules Limited query capabilities RDBMS databases and tools are comparatively mature It does not offer any traditional database capabilities, like consistency when multiple transactions are performed simultaneously. When the volume of data increases it is difficult to maintain unique values as keys become difficult Doesn't work as well with relational data The learning curve is stiff for new developers Open source options so not so popular for enterprises.

45. Mapping of CO with PO CO No. PO 1PO 2PO 3PO 4 PO 5 PO 6PO 7 PO 8 PO 9 PO 10 PO 11 PO 12 PSO1PSO2PSO3 CO1 √ √ √ √ √ √ √ √ √ √ √ CO2 √ √ √ √ √ √ √ √√√ √ √ √ CO3 √ √ √ √ √ √ √ √ √ √ CO4 √ √ √ √ √ √ √ √ √ √ √ √ √ CO5 √ √ √ √ √ √ √ √ √ √ √ √ √ CO6 √ √ √ √ √ √ √ √ √ √ √ √ √ Map ping SM WMWMWM SM SM: Strongly Mapped PO WM: Weakly Mapped PO

46. Thank You Good luck !! 46