POWER QUERY AND OLD SCHOOL HARVESTING XML DATA. JULIE SMITH DATA SERVICES CONSULTANT AT INNOVATIVE ARCHITECTS IN ATLANTA, GA ONE HALF OF THE DATACHIX.COM.

Slides:



Advertisements
Similar presentations
SQL Server Reporting Services By Sam Nasr March 29,
Advertisements

Challenges Facing Enterprise IT REDUCED MANAGEMENT NEW ECONOMICS INCREASED OPPORTUNITIES.
The State of SharePoint BI
Michael Tonderum Solution Architect Aspect Software
SQLSaturday #251 – Paris 2013 Power BI The Road to Self-Service BI (Level 200)
Presented by: Wes Springob Business Intelligence Developer, Agile Bay, Inc.
@georgeault. Analysis Services Reporting Services Integration Services Master Data Services SharePoint Collaboration Excel Workbooks Power Pivot.
JourneyTEAM - – Power BI and You Brent Tenney
Matt Masson| Senior Program Manager
OLAP Data Mart Data Warehouse Client OLTP System(s)
DBA230 Introducing SQL Server 2000 Reporting Services Jason Carlson Product Unit Manager SQL Server Microsoft Corporation.
SPONSORS. Microsoft PowerPivot for SQL Server, Excel 2010, and SharePoint 2010 Michael Herman Syntergy, Inc.
Chapter 3 Files/Folders needed: \Chapter3\Samples \Chapter3\Labs.
Our Powers Combined: Query, Pivot, Map, and View A quick tour through the 4 pillars of Power BI February 11, 2014.
OData: There’s a Feed for That Pablo Castro Software Architect Microsoft Corporation
Sofia Event Center ноември 2013 г. Маги Наумова/ Боряна Петрова.
Back to Basics A Tour of Microsoft SharePoint. Who am I? Kenny Duenke Lead Systems Analyst RGA
Power BI Desktop capabilities level 200 deckTitle: Length and version: 45 minutes Content level:Level 200 for customers and partners Usage Guide: This.
Business Intelligence for everyone 2 For BI to deliver maximum value, all Information Workers must participate: Broad access to uncover and share insights.
Dynamics AX BI Options Featuring Power BI
My Data Wandered Lonely As A Cloud: Azure Data Factory Julie Smith SQL Server MVP Innovative
Business Systems Analyst at MD Anderson Cancer Center Microsoft Office Specialist certified in SharePoint 2013 President of Houston SharePoint User Group.
Introduction to the Power BI Platform Presented by Ted Pattison.
Power BI- best practices
Self-Service Business Intelligence with Power BI Theresa Eller | sharepointmadam.com | slideshare.net/SharePointMadam.
Information Design Tool Overview and Best Practices Natasha Kishinevsky – Business Intelligence Manager.
Build your first Dashboard in Power BI Pro in 60 Minutes.
Data Management Gateway Deep Dive. Thanks to our Main Sponsors:
Share your Excel workbooks in the web Use slicer targets to optionally filter dashboard items Interact with your workbook with all of the rich.
Self-Service Data Integration with Power Query Stéphane Fréchette.
Andy Roberts Data Architect
#SQLSAT454 Using Power BI in Enterprise Andrea
A highway through the mountains of data with the SQL Server Tabular Model This presentation is a walk through in-memory database and reporting features.
Power BI is Awesome! Steve Wake BI Developer, Chipotle Mexican Grill President, Denver SQL Server User Group.
#SQLSAT454 Deep Dive DMG Data Management Gateway(s) Jean-Pierre Riehl
Azure Data Catalog and Power BI. Agenda Azure Data Catalog Overview 1 Publish a data set 2 Metadata 3 Extract and view 4 Q&A 5.
Microsoft Power Query: an Excel Users Dream for Data Extraction and Cleansing Presented by: Belinda Allen Smith & Allen Consulting, Inc.
MAKING BUSINESS INTELLIGENT Brought to you by your local PASS Community! Self Service ETL with Power Query Welcome.
Power BI is Awesome! Steve Wake DW/BI Engineer, National CineMedia (NCM) Chapter Leader, Mile Hi Power BI User Group.
Microsoft Power BI Stack
Apache Hadoop on Windows Azure Avkash Chauhan
Microsoft Power Query 101 Belinda Allen Smith & Allen Consulting, Inc.
Agenda Integration points between Excel and Power BI How can I decide between the two technologies Do I need to chose? Q&A.
What’s new in SSIS 2016 CTP 2.3 (, announced and rumors)
Excel Business Intelligence Tools Lisa Friedrichsen Johnson County Community College Overland Park, Kansas.
Internal Modern Data Platform Somnath Data Platform Architect.
Windows Azure™ Marketplace datasets Ad-hoc reporting Statutory and financial reports Charting and infographics Production reports Excel with Microsoft.
Integrating Power BI with Excel 2016 and Excel Online
Power Up Your Data Analysis with Power BI
Cloud BI with Azure Analysis Services
Microsoft Certification Paths
BIML: Step by Step Julie Smith.
Cloud BI with Azure Analysis Services
<Enter course name here>
Power Query Tips & Tricks
BRK1007 Improve decision-making with Business Analytics in Microsoft Excel 2016 Dany Hoter & Olaf Hubel Senior Program Managers – Excel.
07 | Analyzing Big Data with Excel
TechEd /19/ :10 AM © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered.
“5 Minutes to WOW”, but HOW?
Twitter Movie Sentiment Using Python, SQL Server, Azure SQL DB, Azure ML, & Power BI Bradley Ball
Cloud BI with Azure Analysis Services
Twitter Movie Sentiment Using Python, SQL Server, Azure SQL DB, Azure ML, & Power BI Bradley Ball
Delivering an End-to-End Business Intelligence Solution
نرم افزار گزارش ساز کارنیک
Power Query Tips & Tricks
Donald Donais Minnesota SharePoint Users Group – April 2019
Let’s Build a Tabular Model in Azure
ITI 257 Data Analysis with Power BI
For Exchange Migrations
Paul Southerland Sr. Resource Planning Specialist
Presentation transcript:

POWER QUERY AND OLD SCHOOL HARVESTING XML DATA

JULIE SMITH DATA SERVICES CONSULTANT AT INNOVATIVE ARCHITECTS IN ATLANTA, GA ONE HALF OF THE DATACHIX.COM WITH AUDREY HAMMONDS SQL SERVER ALWAYS FORGET TO UPLOAD MY MATERIALS NOT TODAY!

ROB VOLK ROB VOLK IS A DATABASE ADMINISTRATOR FROM THE ATLANTA, GEORGIA AREA BLOGS AT FORMER MVP

TODAY’S AGENDA STORY OF HOW ANNOYED ROB WAS WITH PLANNING SQL SATURDAYS HAS TO BE A BETTER WAY FORAGING FOR DATA—ON SPEAKERS, VENUES, STRANGE COINCIDENCES POWER QUERY –FIRST CAME OUT AS DATA EXPLORER CURL QUERYING XML WITH SQL (TRANSACT SQL TO BE EXACT)

WHAT WOULD WE LIKE TO KNOW? HOW MANY EVENTS? WHERE ARE THEY? SPEAKER DETAILS (MOST SESSIONS/EVENTS/TRAVELED) SPONSOR DETAILS DATES UPCOMING EVENTS IT’S NOT JUST FOR SATURDAYS!

INTRODUCING POWER QUERY RELEASED JULY 2013 EXCEL ADD-IN FOR 2010 OR 2013 SELF SERVICE ETL!!

POWER BI SUITE POWERPIVOT – IN MEMORY EMBEDDED DATA MODELS POWERMAP POWER VIEW – PRESENTATION READY VISUALIZATIONS POWER QUERY ALL IN EXCEL !!!!

POWER BI OFFICE 365 DATA MANAGEMENT GATEWAY COLLABORATE WITH OFFICE 365 SHAREPOINT HELP/POWER-BI-ADMIN-CENTER-HELP-HA ASPX HELP/POWER-BI-ADMIN-CENTER-HELP-HA ASPX

HISTORY M LANGUAGE FOR BUSINESS ANALYSTS PROJECT OSLO DOMAIN SPECIFIC LANGUAGE M HAS MORPHED INTO THE POWER QUERY FOR EXCEL FORMULA LANGUAGE DOWNLOAD A PDF HERE:

JULIE WHEN SHE FIRST MET POWER QUERY…

IT CAN HARVEST THE FOLLOWING: “OTHER” SHAREPOINT LIST, WINDOWS AZURE MARKETPLACE, ANY HADOOP FILE (HDFS), HDINSIGHT, ACTIVE DIRECTORY, FACEBOOK. EXCHANGE ** NEW RDBMS: SQL SERVER, AZURE SQL SERVER, ACCESS (OOPS), ORACLE, DB2, MYSQL, POSTGRESS, TERADATA FILE: EXCEL, CSV, TXT,, XML, JSON, FOLDER (METADATA) FROM THE INTARWEBZ! WRITE AN M OR POWER QUERY FORMULA LANGUAGE QUERY YOURSELF FROM SCRATCH

SOURCES REGULAR SOURCES—MOST DATABASE PLATFORMS INCLUDING HADOOP FILES—ALL TYPES ODATA WEB SITE TABLES! ACTIVE DIRECTORY!

FUNCTIONS TRANSFORMATION! MERGE (JOIN ON KEY) APPEND—COMBINE SOURCES TO NEW DESTINATION

CREATE YOUR OWN FUNCTION

Goes To symbol

USE YOUR OWN FUNCTION

RESOURCES FORMULAS-HA ASPX FORMULA CHEAT SHEET FORMULAS-HA ASPX GREAT POST BY DATAPIG THINGS-YOU-CAN-DO-WITH-DATA-EXPLORER/ THINGS-YOU-CAN-DO-WITH-DATA-EXPLORER/ ON M LANGUAGE: SERVER-MODELING-CTP-REPOSITORY-MODELING-SERVICES-QUOT-QUADRANT-QUOT-AND- QUOT-M-QUOT.ASPX SERVER-MODELING-CTP-REPOSITORY-MODELING-SERVICES-QUOT-QUADRANT-QUOT-AND- QUOT-M-QUOT.ASPX M LANGUAGE SPECS FROM MICROSOFT: US/LIBRARY/DD ASPXHTTP://MSDN.MICROSOFT.COM/EN- US/LIBRARY/DD ASPX DOWNLOADABLE 200 PAGE DOC ON FORMULA LANGUAGE (M)

RESOURCES FROM ROB (MORE RECENT) to-automateparameterizeloop-power-query?forum=powerqueryhttps://social.technet.microsoft.com/Forums/en-US/0f9fec c56-92ec-00d46b26b3fc/how- to-automateparameterizeloop-power-query?forum=powerquery HA aspxhttps://office.microsoft.com/en-us/excel-help/learn-about-data-explorer-formulas- HA aspx HA aspx?CTT=5&origin=HA HA aspx?CTT=5&origin=HA