Presentation is loading. Please wait.

Presentation is loading. Please wait.

1 icfi.com | MongoDB and Spring Data January 21 st, 2013 Prepared for: THE TRIANLGE JAVA USER’S GROUP.

Similar presentations


Presentation on theme: "1 icfi.com | MongoDB and Spring Data January 21 st, 2013 Prepared for: THE TRIANLGE JAVA USER’S GROUP."— Presentation transcript:

1 1 icfi.com | MongoDB and Spring Data January 21 st, 2013 Prepared for: THE TRIANLGE JAVA USER’S GROUP

2 2 icfi.com | Integrated Services ICF IRONWORKS Interactive Portal + Content Management Business + IT Alignment Interactive Developing creative ideas and engaging audiences through Web, Mobile, and Social Media User + Industry Research Web Analytics Digital Strategy + Planning Mobile Strategy + Execution Search Marketing Rich Media Development Social Media + Monitoring Information Architecture + Usability Creative Design Portal + Content Management Building Internet-based systems to share content, knowledge, and data Portal Enterprise Content Management Search E-Commerce Custom Application Development Systems Integration Cloud Services Application + Platform Management Business + IT Alignment Developing practical strategies to help clients improve business performance Program + Portfolio Management IT Strategy and Roadmap Technology Selection Business Process Improvement Governance Business Intelligence

3 3 icfi.com |  ICF Ironworks has experience in the following market-leading platforms: Microsoft Ektron Autonomy Interwoven Oracle UCM and WebLogic Portal Alfresco SiteCore Percussion IBM WebSphere  We leverage our strategic partnerships to enhance the services we provide to our clients and to build on our sales pipeline  ICF Ironworks is one of 34 Microsoft National Systems Integrators (NSI) Partnerships and Platform Expertise ICF IRONWORKS

4 4 icfi.com | Government Non-Profit/Assn Financial Energy Mfg/Retail/Distribution Healthcare ICF IRONWORKS

5 5 icfi.com | Who Am I?  Solutions Architect with ICF Ironworks  Part-time Adjunct Professor  Started with HTML and Lotus Notes in 1992 In the interim there was C, C++, VB, Lotus Script, PERL, LabVIEW, etc.  Not so much an Early Adopter as much as a Fast Follower of Java Technologies  Alphabet Soup (MCSE, ICAAD, ICASA, SCJP, SCJD, PMP, CSM)  LinkedIn:  Blog: Avoiding Tech-sandhttp://jimmyraywv.blogspot.com/

6 6 icfi.com | MongoDB and Spring Data

7 7 icfi.com | Tonight’s Agenda  Quick introduction to NoSQL and MongoDB Configuration MongoView  Introduction to Spring Data and MongoDB support Spring Data and MongoDB configuration Templates Repositories Query Method Conventions Custom Finders Customizing Repositories Metadata Mapping (including nested docs and DBRef) Aggregation Functions GridFS File Storage Indexes

8 8 icfi.com | What is NoSQL?  Official: Not Only SQL In reality, it may or may not use SQL*, at least in its truest form Varies from the traditional RDBMS approach of the last few decades Not necessarily a replacement for RDBMS; more of a solution for more specific needs where is RDBMS is not a great fit Content Management (including CDNs), document storage, object storage, graph, etc.  It means different things to different folks. It really comes down to a different way to view our data domains for more effective storage, retrieval, and analysis

9 9 icfi.com | From NoSQL-Database.org “NoSQL DEFINITION: Next Generation Databases mostly addressing some of the points: being non-relational, distributed, open-source and horizontally scalable. The original intention has been modern web-scale databases. The movement began early 2009 and is growing rapidly. Often more characteristics apply such as: schema-free, easy replication support, simple API, eventually consistent / BASE (not ACID), a huge amount of data and more.”

10 10 icfi.com | Some NoSQL Flavors  Document Centric MongoDB Couchbase  Wide Column/Column Families Cassandra Hadoop Hbase  XML MarkLogic  Graph Neo4J  Key/Value Stores Redis  Object DB4O  Other LotusNotes/Domino

11 11 icfi.com | Why MongoDB  Open Source (written in C++)  Multiple platforms (Linux, Win, Solaris, Apple) and Language Drivers  Explicitly de-normalized  Document-centric and Schema-less  Fast (low latency) Fast access to data Low CPU overhead  Ease of scalability (replica sets), auto-sharding  Manages complex and polymorphic data  Great for CDN and document-based SOA solutions  Great for location-based and geospatial data solutions

12 12 icfi.com | Why MongoDB (more)  Because of schema-less approach is more flexible, MongoDB is intrinsically ready for iterative (Agile) projects.  Eliminates “impedance-mismatching” with typical RDBMS solutions  “How do I model my application in 3NF?”  If You are already familiar with JavaScript and JSON, this is an easy database to understand.

13 13 icfi.com | What is schema-less?  A.K.A. schema-free  It means that MongoDB does not enforce a column data type on the fields within your document, nor does it confine your document to specific columns defined in a table definition.  The schema is actually controlled via the application API layers and is implied by the “shape” (content) of your documents.  This means that different documents in the same collection can have different fields. So the schema is flexible in that way Only the _id field is mandatory in all documents.  Requires more rigor on the application side.

14 14 icfi.com | Why Not MongoDB  High speed and deterministic transactions: Banking and accounting  Where SQL is absolutely required Where Joins are needed  Traditional non-real-time data warehousing ops  If your organization lacks the controls and rigor to place schema and document definition at the application level without compromising data integrity

15 15 icfi.com | MongoDB  Was designed to overcome some of the performance shortcomings of RDBMS  Some Features Fast Querying (atomic operations, embedded data) In place updates (physical writes lag in-memory changes) Full Index support (including compound indexes) Replication/High Availability (see CAP Theorem) Auto Sharding (range-based portioning, based on shard key) for scalability Aggregation, MapReduce GridFS

16 16 icfi.com | MongoDB – In Place Updates  Physical disk writes lag in-memory changes. Multiple writes in memory can occur before the object is updated on disk  MongoDB uses an adaptive allocation algorithm for storing its objects. If an object changes and fits in it’s current location, it stays there. However, if it is now larger, it is moved to a new location. This moving is expensive for index updates MongoDB looks at collections and based on how many times items grow within a collection, MongoDB calculates a padding factor that trys to account for object growth This minimizes object relocation

17 17 icfi.com | MongoDB – A Word About Sharding…  Need to choose the right key Easily divisible (“splittable”– see cardinality) so that Mongo can distribute data among shards “all documents that have the same value in the state field must reside on the same shard” – 10Gen Enable distributed write operations between cluster nodes Prevents single-shard bottle-necking Make it possible for “Mongos” return most query operations from a single mongod instance “users will generally have a unique value for this field, MongoDB will be able to split as many chunks as needed” – 10Gen

18 18 icfi.com | MongoDB – Cardinality…  You want higher cardinality to allow chunks of data to be split among shards Example: Address data components State – Low Cardinality ZipCode – Potentially low or high, depending population Phone Number – High Cardinality

19 19 icfi.com | CAP Theorem  C onsistency  A vailability  P artition Tolerance (network partition tolerance)  You can never have all three, so you plan for two and make the best of the third. For example: Perhaps “eventual consistency” is OK for a CDN application. For large scalability, you would need partitioning. That leaves C & A to choose from Would you ever choose consistency over availability?

20 20 icfi.com | Container Models: RDBMS vs. MongoDB  RDBMS: Servers > Databases > Schemas > Tables > Rows Joins, Group By, ACID  MongoDB: Servers > Databases > Collections > Documents No Joins Instead: Db References (Linking) and Nested Documents (Embedding)

21 21 icfi.com | MongoDB Collections  Schema-less  Can have up to (according to 10gen) Cheap to resource  Contain documents (…of varying shapes) 100 nesting levels (version 2.2)  Are namespaces, like indexes  Can be “Capped” Limited in max size with rotating overwrites of oldest entries Example: oplog

22 22 icfi.com | MongoDB Documents  JSON (what you see) Actually BSON (Internal - Binary JSON -  Elements are name/value pairs  16 MB maximum size  What you see is what is stored No default fields (columns)

23 23 icfi.com | Why BSON?  Adds data types that JSON did not support  Optimized for performance  Adds compression

24 24 icfi.com | MongoDB Install  Extract MongoDB  Build config file, or use startup script Need dbpath configured Need REST configured for Web Admin tool  Start Mongod (daemon) process  Use Shell (mongo) to access your database  Use MongoVUE for GUI access and to learn shell commands

25 25 icfi.com | Mongo Shell  In Windows, mongo.exe  Command-line interface to MongoDB (sort of like SQL*Plus for Oracle)

26 26 icfi.com | MongoVUE  GUI around MongoDB Shell  Makes it easy to learn MongoDB Shell commands db.employee.find({ "lastName" : "Smith", "firstName" : "John" }).limit(50); show collections  Demo…

27 27 icfi.com | Web Admin Interface  Localhost:28017  Quick stats viewer  Run commands  Demo  There is also Sleepy Mongoose mongodb-rest-interface/

28 28 icfi.com | Spring Data  Large Spring project with many subprojects Category: Document Stores, Subproject MongoDB  “…aims to provide a familiar and consistent Spring-based programming model…”  Like other Spring projects, Data is POJO Oriented  For MongoDB, provides high-level API and access to low-level API for managing MongoDB documents.  Provides annotation-driven meta-mapping  Will allow you into bowels of API if you choose to hang out there

29 29 icfi.com | Spring Data MongoDB Templates  Implements MongoOperations (mongoOps) interface mongoOps defines the basic set of MongoDB operations for the Spring Data API. Wraps the lower-level MongoDB API  Provides access to the lower-level API  Provides foundation for upper-level Repository API.

30 30 icfi.com | Spring Data MongoDB Templates - Configuration  See mongo-config.xml

31 31 icfi.com | Spring Data MongoDB Templates - Configuration  Or…see the config class

32 32 icfi.com | Spring Data Repositories  Convenience for data access Spring does ALL the work (unless you customize)  Convention over configuration Uses a method-naming convention that Spring interprets during implementation  Hides complexities of Spring Data templates and underlying API  Builds implementation for you based on interface design Implementation is built during Spring container load.  Is typed (parameterized via generics) to the model objects you want to store. When extending MongoRepository Otherwise annotation

33 33 icfi.com | Spring Data Meta Mapping  Annotation-driven mapping of model object fields to Spring Data elements in specific database dialect.

34 34 icfi.com | MongoDB DBRef  Optional  Instead of nesting documents  Have to save the “referenced” document first, so that DBRef exists before adding it to the “parent” document

35 35 icfi.com | MongoDB Custom Spring Data Repositories  Hooks into Spring Data bean type hierarchy that allows you to add functionality to repositories  Important: You must write the implementation for part of this custom repository  And…your Spring Data repository interface must extend this custom interface, along with the appropriate Spring Data repository  Demo

36 36 icfi.com | Creating a Custom Repository  Write an interface for the custom methods  Write the implementation for that interface  Write the traditional Spring Data Repository application interface, extending the appropriate Spring Data interface and the (above) custom interface  When Spring starts, it will implement the Spring Data Repository normally, and include the custom implementation as well.

37 37 icfi.com | MongoDB Advanced Queries  cedQueries-%24all cedQueries-%24all  Demo - $in, $nin, $gt, $all

38 38 icfi.com | MongoDB Aggregation Functions  Aggregation Framework  Map/Reduce  Distinct - Demo  Group - Demo Similar to SQL Group By function  Count

39 39 icfi.com | MongoDB GridFS  “…specification for storing large files in MongoDB.”  As the name implies, “Grid” allows the storage of very large files divided across multiple MongoDB documents. Uses native BSON binary formats  16MB per document Will be higher in future  Large files added to GridFS get chunked and spread across multiple documents.

40 40 icfi.com | MongoDB Indexes  Similar to RDBMS Indexes  Can have many  Can be compound Including indexes of array fields in document  Makes searches, aggregates, and group functions faster  Makes writes slower  Sparse = true Only include documents in this index that actually contain a value in the indexed field.

41 41 icfi.com | MongoDB Security  on  Default is trusted mode, no security  --auth  --keyfile Replica sets require this option

42 42 icfi.com | MongoDB Encryption  MongoDB does not support data encryption, per se  Use application-level encryption and store encrypted data in BSON fields  Or…use TDE (Transparent Data Encryption) from Gazzang

43 43 icfi.com | MongoDB 2.2  Drop-in replacement for 1.8 and 2.0.x  Aggregation without Map Reduce  TTL Collections (alternative to Capped Collections)  Tag-aware Sharding 

44 44 icfi.com | Helpful Links  Spring Data MongoDB - Reference Documentation: mongodb/docs/1.0.2.RELEASE/reference/html/ mongodb/docs/1.0.2.RELEASE/reference/html/         https://www.10gen.com/presentations/webinar/online-conference-deep-dive- mongodb https://www.10gen.com/presentations/webinar/online-conference-deep-dive- mongodb

45 45 icfi.com | Questions


Download ppt "1 icfi.com | MongoDB and Spring Data January 21 st, 2013 Prepared for: THE TRIANLGE JAVA USER’S GROUP."

Similar presentations


Ads by Google