Presentation is loading. Please wait.

Presentation is loading. Please wait.

1 The Netflix Data Platform – A Recipe for High Business Impact Kurt Brown, Director, Data Platform.

Similar presentations


Presentation on theme: "1 The Netflix Data Platform – A Recipe for High Business Impact Kurt Brown, Director, Data Platform."— Presentation transcript:

1 1 The Netflix Data Platform – A Recipe for High Business Impact Kurt Brown, Director, Data Platform

2 Agenda Architecture Cloud OSS Philosophy

3 Architecture

4

5 S3S3

6 ~5 PB S3S3

7

8

9

10 vs.

11

12

13

14

15

16

17

18

19

20 Sting

21

22 S3 Sting Data Platform

23 Te z / Shark

24 ? S3 Data Platform Tez Yarn ??? Sting

25 Cloud

26 Ye s

27 OSS

28

29 Cos t

30

31 Flexibility Growth Spikes Self-service

32 Services SQS, EMR, S3,… Available Focus!

33 Redundancy / Global Presence Multi-DC International

34 Cloud Native Build for failure Swing systems Excess capacity

35 Right for everyone? Are you Google or Facebook? Netflix Undifferentiated Opportunity Cost

36 Cost ?

37 OSS

38 General OSS Pooled goodness Manage own destiny Vendor relationships Conflicting agendas

39 Netflix OSS Meet Netflix needs Shared direction Recruiting & Retention Code quality Contributions

40 Data Platform OSS Genie Lipstick Aegisthus S3mper Suro Future: Inviso

41 Should you open source? We’re all using it You get value Others would get value Will invest some time

42 Philosophy

43 Netflix Expense Policy “Act in Netflix’s Best Interest”

44 Development & Deployment Flow Best Practices Components Consultation Tools Automation Clean-up

45 DBAs?

46 QA Team?

47 Testing

48 Accept things WILL break

49 Safety Nets

50 Give folks what they need

51 Eliminate Process Status Reports Tickets Documentation

52 Tell vs. Ask

53 Does it really matter?

54 Questions?


Download ppt "1 The Netflix Data Platform – A Recipe for High Business Impact Kurt Brown, Director, Data Platform."

Similar presentations


Ads by Google