virtual techdays INDIA │ 9-11 February 2011 virtual techdays Data grail: Data Market on Windows Azure Sudhindra Kovalam │ Developer, Icertis Inc.
An Introduction to Windows Azure Marketplace DataMarket V1 Why is Data important & Why would I Need something like DataMarket in the first place? Ok Cool, What sorts of data is available on the DataMarket Developing Applications on DataMarket Using Power Pivot plugin for Microsoft Excel Developing simple applications using Data Market Inside Windows Azure DataMarket Some more details about DataMarket DataMarket internals Wrap-up virtual techdays INDIA │ 9-11 February 2011 S E S S I O N A G E N D A
Data is the new “OIL” - Gerd Leonhard Many of the decisions we take in our day to day life are based on some sort of statistical data. As an end-user, you always want to have some statistic or data to make decisions. Discoverability and reliability Many sources on the internet such as blogs, hosted documents, websites etc. Making sense out of the data and basing your decisions on that data. virtual techdays INDIA │ 9-11 February 2011 A N I N T R O D U C T I O N T O D AT A M A R K E T
virtual techdays INDIA │ 9-11 February 2011 virtual techdays Example : A Site Selection application for a Retail store Chain
virtual techdays INDIA │ 9-11 February 2011 virtual techdays W h a t’ s D a t a M a r k e t
virtual techdays INDIA │ 9-11 February 2011 DEVELOPING APPLICATIONS USING DATAMARKET How does DataMarket help? I Need Data! semantics billing schema discovery hosting
virtual techdays INDIA │ 9-11 February 2011 virtual techdays ENTER: MARKETPLACE DATAMARKET
virtual techdays INDIA │ 9-11 February 2011 DEVELOPING APPLICATIONS USING DATAMARKET How does DataMarket help? semantics billing schema discovery hosting Consumer Spending Climate Real Estate Value DataMarket MarketplaceMarketplace BillingBilling VisualizationVisualization Services for Content Providers Standard Data Access (OData)
virtual techdays INDIA │ 9-11 February 2011 Marketplace DataMarket Content Providers DataMarket Launch 45+ Content partners 60+ Data offerings 100+ Offers coming soon
virtual techdays INDIA │ 9-11 February 2011 virtual techdays Demo : Windows Azure Marketplace DataMarket Walkthrough
Using PowerPivot plugin for Excel 2010 PowerPivot gives users the power to create compelling self-service BI solutions Get PowerPivot from Via Managed Code Add “Service Reference” to Dataset end point to consume the dataset via code. virtual techdays INDIA │ 9-11 February 2011 Exploring Data Market Datasets
virtual techdays INDIA │ 9-11 February 2011 virtual techdays Demo : Using PowerPivot for Excel 2010
ODATA Protocol for querying and updating data. Based on AtomPub, HTTP, JSON Provides access to information from a variety of applications, services, and stores. Released under the Open Specification Promise. Visit for more details. ODATA Clients Existing - Java, PHP, AJAX,.NET, Silverlight, Excel New – iPhone, Windows Phone 7 CTP, Linqpad, etc. virtual techdays INDIA │ 9-11 February 2011 Developing Applications using Data Market ODATA
Key Features of DataMarket APIs The Metadata service document is exposed. Useful in building a generic application which would work across multiple DataMarket datasets. Service side filtering. Fixed and Flexible Query Types (Controlled by the content provider) Fixed Querying For e.g. Proxy classes cannot be generated by doing a “Add Service reference” The proxy class file is available on the dataset Details page after the subscription is purchased or subscribed to. Flexible Querying For e.g. company.com/accountbalance/GetAccountBalance?phonenumber= https://api.datamarket.azure.com/Data.ashx/thephone- company.com/accountbalance/GetAccountBalance?phonenumber= We can do a “Add Service reference for such datasets. virtual techdays INDIA │ 9-11 February 2011 Developing Applications using Data Market Key Features of Azure DataMarket
virtual techdays INDIA │ 9-11 February 2011 virtual techdays Demo : Consuming a DataMarket dataset via Code
virtual techdays INDIA │ 9-11 February 2011 Basic Building Blocks
virtual techdays INDIA │ 9-11 February 2011 Processing Requests
virtual techdays INDIA │ 9-11 February 2011 Caching requests
virtual techdays INDIA │ 9-11 February 2011 Connecting to Content Provider’s Data
virtual techdays INDIA │ 9-11 February 2011 Scaling Out User DBs
virtual techdays INDIA │ 9-11 February 2011 Monitoring Discover issues before customer! Build monitoring as Windows Azure web role Deployed to multiple data centers Executes sample queries on regular base Stores result in Windows Azure Table Logs transferred on a regular basis to SQL Azure Reporting services to create reports Alerting on condition matching
virtual techdays INDIA │ 9-11 February 2011 Securing High value data Problem: how to secure 3 rd party connection information? Solution: Certificates! Windows Azure has dedicated certificate pipeline Only small number of people need access to them Connection information encrypted with final key during publication process Certificates to decrypt connection information on the fly Connecting to data sources
virtual techdays INDIA │ 9-11 February 2011 The Big Picture
Enrolling as a Data consumer? Visit Enrolling as a Content Provider You are in control of the data, price, and terms Easily onboard data from SQL Azure or existing web services Receive periodic reports and payouts Get in touch with the Data Market On Boarding team : virtual techdays INDIA │ 9-11 February 2011 How Do I Enroll
Questions? Use the “Ask a Question” button on the VTD site Or use the “Q & A Panel” on the Live Meeting console. Contact Details Blog : virtual techdays INDIA │ 9-11 February 2011
virtual techdays INDIA │ 9-11 February 2011 virtual techdays Thank you