Presentation is loading. Please wait.

Presentation is loading. Please wait.

Artemis Logs Database View Data Collectio n GUI Dryad Overview Data collection Distributed system Plug-ins GUI Plug-ins Hunting for Bugs with Artemis System.

Similar presentations


Presentation on theme: "Artemis Logs Database View Data Collectio n GUI Dryad Overview Data collection Distributed system Plug-ins GUI Plug-ins Hunting for Bugs with Artemis System."— Presentation transcript:

1 Artemis Logs Database View Data Collectio n GUI Dryad Overview Data collection Distributed system Plug-ins GUI Plug-ins Hunting for Bugs with Artemis System Architecture Conclusio ns

2 pptPlex Section Divider Hunting for Bugs with Artemis The slides after this divider will be grouped into a section and given the label you type above. Feel free to move this slide to any position in the deck.

3 Hunting for Bugs with Artemis Gabriela F. Creţu-Ciocârlie Mihai Budiu Moises Goldszmidt Microsoft Research, Silicon Valley WASL 2008 This presentation is built and should be viewed with pptPlex: http://www.officelabs.com/projects/pptPlex/Pages

4 Artemis Goal One-stop shop for performance analysis of distributed systems

5 Principles 1) Modular: Separate generic from application specific parts 2) Extensible: add new analyses via plug-ins 3) Interactive: human expert part of the analysis loop

6 pptPlex Section Divider System Architecture The slides after this divider will be grouped into a section and given the label you type above. Feel free to move this slide to any position in the deck.

7 Logs Database View Data collection Distributed system Plug-ins GUI Distributed Local

8 Logs Database View Data collection Distributed system Plug-ins GUI Application- Specific Generic

9 pptPlex Section Divider Dryad Overview The slides after this divider will be grouped into a section and given the label you type above. Feel free to move this slide to any position in the deck.

10 grep sed sort awk perl grep sed sort awk Input files Vertices Output files ChannelsStage Dryad Application Structure

11 Dryad System Architecture data plane job schedule control plane Serv V VV Job managercluster

12 pptPlex Section Divider Data Collection The slides after this divider will be grouped into a section and given the label you type above. Feel free to move this slide to any position in the deck.

13 TextBinaryXMLPerfmon TextBinaryXMLPerfmon Data Persisted data Copy Parse Filter Aggregate DryadLINQ application 10GB-1TB 100MB-1GB TextBinaryXMLPerfmon

14 pptPlex Section Divider GUI The slides after this divider will be grouped into a section and given the label you type above. Feel free to move this slide to any position in the deck.

15

16

17

18

19 pptPlex Section Divider Plug-ins The slides after this divider will be grouped into a section and given the label you type above. Feel free to move this slide to any position in the deck.

20

21 Machine Utilization Plug-in

22 Complex statistics: HiLighter plug-in 22 Metrics Binary search over logistic regression with L1 regularization Key Performance Indicator Correlated metrics

23 Interactive Analysis Feature Computation Visualization Hilighter KPI Selection

24 pptPlex Section Divider Conclusions The slides after this divider will be grouped into a section and given the label you type above. Feel free to move this slide to any position in the deck.

25 Raw data Summarization Feature extraction Statistical analyses Automatic diagnosis Distributed system Artemis today Goal Conclusions


Download ppt "Artemis Logs Database View Data Collectio n GUI Dryad Overview Data collection Distributed system Plug-ins GUI Plug-ins Hunting for Bugs with Artemis System."

Similar presentations


Ads by Google