Presentation is loading. Please wait.

Presentation is loading. Please wait.

BUILDING TOOLS FOR THE HADOOP DEVELOPER matt

Similar presentations


Presentation on theme: "BUILDING TOOLS FOR THE HADOOP DEVELOPER matt"— Presentation transcript:

1 BUILDING TOOLS FOR THE HADOOP DEVELOPER matt winkler @mwinkle

2 Agenda What are we up to? Overview of the problem space Dives and demos

3

4

5 Existing Ecosystem Actively contributing to: Core Pig Hive HCatalog Branching to other projects Simple one-box developer install on Windows

6 .NET Map/Reduce LINQ to Hive Client APIs WebHCat Ambari WebHDFS Azure Visual Studio Tooling Local debugging support

7 JavaScript MRjs – Map/Reduce in JavaScript Node.js client APIs WebHCat WebHDFS Ambari Azure

8 Management UI Tooling Cluster usage Job authoring Result consumption in common tools PowerShell & Cross platform scripting API Surface RDFE – Azure provisioning Ambari – Cluster monitoring WebHCatalog – Metadata and job submission WebHDFS, Blob Storage – Storage Management Portal >_ Scripting (Windows, Linux and Mac) REST API

9 Sources http://hadoopsdk.codeplex.com http://www.github.com/windowsazure NuGet packages Microsoft.Hadoop.MapReduce Microsoft.Hadoop.Hive Microsoft.Hadoop.WebHDFS => WebClient NPM packages Azure Azure-cli Hadoop REST clients pending… open

10 Big Data. Small Data. All Data. www.microsoft.com/bigdata Learn More: February 28 9:05amMicrosoft Keynote by Dave Campbell 9:45amMicrosoft Keynote by Kate Crawford 10:40amMicrosoft Sponsored Session in Partnership with Ascribe 11:30amDave Campbells Office Hours


Download ppt "BUILDING TOOLS FOR THE HADOOP DEVELOPER matt"

Similar presentations


Ads by Google