Unlock your Big Data with Analytics and BI on Office365 Brian Culver ● SharePoint Fest Denver ● SPT 104 ● March 1-3, 2016

About Brian Culver, MCM  SharePoint Solutions Architect for Expert Point Solutions in Houston, Texas.  Microsoft Certified Master (MCM) in SharePoint  Microsoft Certified Professional Developer (MCPD).  Brian has worked in the Information Technology industry for since 1998 and he has been working with SharePoint since His deep expertise includes Azure, Office365, SharePoint, ASP.Net, SQL Server and Project Server. He has been involved in many large SharePoint implementations including Internet and Intranet sites, Partner Portals, Enterprise Content Management and Governance, and much custom application integration and development.  Author, Speaker and Blogger brian.culver(at)expertpointsolutions.com Twitter LinkedIn : Blog :

Session Agenda  What is Big Data?  Understanding Sentiment Analysis  Connecting Big Data and Business Intelligence  Create an Azure HDInsight Cluster  Load data into Blob Storage  Validate data via HDInsight  Hadoop and C#  Visualizing Results via PowerView  Closing comments

What is Big Data?  Big Data is about personalization and knowledge. Understanding our customers and relationships to the world. 27% of customers have seen Personalization online 86% of those say Personalization influenced what they purchased to some extent 31% want a more Personalized experience 59% of customers who have experienced Personalization believe it has a noticeable influence on purchasing 58% prefer product recommendations from previous purchases over other forms of personalization

What is Big Data?

 Big Data is data that is “too” complex, large, and/or fast.  Big Data offers a new set of approaches for analyzing data sets that were not previously accessible which posed challenges across one or more of the “3 V’s”:  Volume - too big and large - Terabytes (and more) of credit card transactions, web usage data, system logs, etc.  Variety - too Complex - Unstructured data such as social media, customer reviews, call center records, etc.  Velocity - too Fast - Sensor data, live web traffic, mobile phone usage, GPS data, etc.

Data Complexity: Variety and Velocity Terabytes Gigabytes Megabytes Petabytes What is Big Data?

Web app optimization Smart meter monitoring Advertising analysis Fraud detection Healthcare outcomes Weather forecasting Natural resource exploration Social network analysis Traffic flow optimization IT infrastructure optimization Legal discovery COMMON BIG DATA CUSTOMER SCENARIOS GAIN COMPETITIVE ADVANTAGE BY MOVING FIRST AND FAST IN YOUR INDUSTRY Internet of Things (IoT)

What is Big Data?  How are customers using HDInsight?  Azure HDInsight + Machine Learning  How Pier 1 uses HDInsight to improve and customize customer experience:

What is Big Data?  Ambari - Cluster provisioning, management, and monitoring.  Avro (Microsoft.NET Library for Avro) - Data serialization for the Microsoft.NET environment.  Hive - Structured Query Language (SQL)-like querying.  Mahout - Machine learning.  MapReduce and YARN - Distributed processing and resource management.  Oozie - Workflow management.  Pig - Simpler scripting for MapReduce transformations.  Sqoop - Data import and export.  ZooKeeper - Coordination of processes in distributed systems.

REDUCE MAP Map + Reduce = Extract, Load + Transform Raw Data Mapper Data Reducer Output What is Big Data?

Understanding Sentiment Analysis  Sentiment Analysis is the process of understanding the emotional content of text.

Understanding Sentiment Analysis I had a fantastic time on holiday at your resort. The service was excellent and awesome. My family really enjoyed themselves. We look forward to next year. One thing though, the pool was closed which sucked. Hotel Feedback

Understanding Sentiment Analysis  Take a list of positive and negative words Positive Good Great Fantastic Excellent Friendly Awesome Enjoyed Negative Bad Worse Rubbish Sucked Awful Terrible Bogus

Understanding Sentiment Analysis I had a fantastic time on holiday at your resort. The service was excellent and awesome. My family really enjoyed themselves. We look forward to next year. One thing though, the pool was closed which sucked. Hotel Feedback

Understanding Sentiment Analysis Positive Fantastic Excellent Awesome Enjoyed Negative Sucked 41

Understanding Sentiment Analysis 41-=3 Overall sentiment  Positive

Understanding Sentiment Analysis  Sentiment Analysis gets a lot more complicated…

Big Data & Business Intelligence In the following demo, we will cover the following: 1.[If you don’t have one] Create an Azure Account 2.Go to 3.Create Storage 4.Create HDInsight Cluster 5.Load data into Blob Storage 6.Validate data via HDInsight 7.Hadoop and C# 8.Visualizing Results via Excel PowerView

Connecting Big Data and Business Intelligence Demo

Closing Comments  Big Data is about understanding what your customers are saying and thinking.  Anything can be understood and processed but it requires time to analyze and understand.  Any device that creates data can produce valuable information.  Try different things and let the patterns emerge.  But Where Is Big Data’s ROI?  Collecting data - the kind of data that provides valuable insights into customer preferences, cost savings and revenue generation.  Roughly 40% of companies are unsure whether they’ll receive any return—and that includes 38% of companies that have already made some investment in big data, according to Gartner data (437 large companies surveyed in June 2015).Gartner  “Gartner has also warned that the majority of big data projects in the short term are likely to fail.”

Thank you Brian Culver, MCM   brian.culver(at)expertpointsolutions.com  Blog:  Slides:

Questions ? ? ? ?

Constructive Feedback Is Appreciated Great information, but would like to have learned more about [Insert Topic] Brian – Your presentation was … Good Demos! Thanks!

Thank you! Brian Culver, MCM brian.culver(at)expertpointsolutions.com Blog: Slides:

Resources  Twitter Sentiment Processing   sentiment/ sentiment/  odbc-driver/ odbc-driver/  data-98268d31-97e2-42aa-a52b-a68cf460472e data-98268d31-97e2-42aa-a52b-a68cf460472e  SharePoint-Server-99127d68-d7b7-42d0-a4ee-20e2d ?ui=en-US&rs=en- CA&ad=CA SharePoint-Server-99127d68-d7b7-42d0-a4ee-20e2d ?ui=en-US&rs=en- CA&ad=CA  e9c884650a26?ui=en-US&rs=en-CA&ad=CA e9c884650a26?ui=en-US&rs=en-CA&ad=CA    started/ started/  art&refval= &qid=2aa e7aae26523f4 art&refval= &qid=2aa e7aae26523f4 