More Codes Never Enough. 2 EVENODD Code Basics of EVENODD code  each storage node as a single column # of data nodes k = p (prime) # of total nodes n.

Slides:



Advertisements
Similar presentations
A CASE FOR REDUNDANT ARRAYS OF INEXPENSIVE DISKS (RAID) D. A. Patterson, G. A. Gibson, R. H. Katz University of California, Berkeley.
Advertisements

1 A triple erasure Reed-Solomon code, and fast rebuilding Mark Manasse, Chandu Thekkath Microsoft Research - Silicon Valley Alice Silverberg Ohio State.
RAID (Redundant Arrays of Independent Disks). Disk organization technique that manages a large number of disks, providing a view of a single disk of High.
1 On the Speedup of Single-Disk Failure Recovery in XOR-Coded Storage Systems: Theory and Practice Yunfeng Zhu 1, Patrick P. C. Lee 2, Yuchong Hu 2, Liping.
Lecture 19: Parallel Algorithms
Analysis and Construction of Functional Regenerating Codes with Uncoded Repair for Distributed Storage Systems Yuchong Hu, Patrick P. C. Lee, Kenneth.
Alex Dimakis based on collaborations with Dimitris Papailiopoulos Arash Saber Tehrani USC Network Coding for Distributed Storage.
CSCE430/830 Computer Architecture
The CORS method Selecting the roots of a system of polynomial equations with combinatorial optimization H. Bekker E.P. Braad B. Goldengorin University.
Data Manipulation Overview and Applications. Agenda Overview of LabVIEW data types Manipulating LabVIEW data types –Changing data types –Byte level manipulation.
15-853:Algorithms in the Real World
Information and Coding Theory
BASIC Regenerating Codes for Distributed Storage Systems Kenneth Shum (Joint work with Minghua Chen, Hanxu Hou and Hui Li)
Coding and Algorithms for Memories Lecture 12 1.
Simple Regenerating Codes: Network Coding for Cloud Storage Dimitris S. Papailiopoulos, Jianqiang Luo, Alexandros G. Dimakis, Cheng Huang, and Jin Li University.
1 STAIR Codes: A General Family of Erasure Codes for Tolerating Device and Sector Failures in Practical Storage Systems Mingqiang Li and Patrick P. C.
Quine-McCluskey (Tabular) Minimization  Two step process utilizing tabular listings to:  Identify prime implicants (implicant tables)  Identify minimal.
A Comprehensive Study on RAID6 Codes: Horizontal vs. Vertical Chao Jin*, Dan Feng*, Hong Jiang†, Lei Tian*† *Huazhong University of Science and Technology.
Chapter 3 Presented by: Anupam Mittal.  Data protection: Concept of RAID and its Components Data Protection: RAID - 2.
Availability in Globally Distributed Storage Systems
Data Compressor---Huffman Encoding and Decoding. Huffman Encoding Compression Typically, in files and messages, Each character requires 1 byte or 8 bits.
Data Persistence in Sensor Networks: Towards Optimal Encoding for Data Recovery in Partial Network Failures Abhinav Kamra, Jon Feldman, Vishal Misra and.
Rectangle Image Compression Jiří Komzák Department of Computer Science and Engineering, Czech Technical University (CTU)
Optimal Sum of Pairs Multiple Sequence Alignment David Kelley.
A Hybrid Approach of Failed Disk Recovery Using RAID-6 Codes: Algorithms and Performance Evaluation Yinlong Xu University of Science and Technology of.
Incremental Network Programming for Wireless Sensors IEEE SECON 2004 Jaein Jeong and David Culler UC Berkeley, EECS.
Tirgul 8 Universal Hashing Remarks on Programming Exercise 1 Solution to question 2 in theoretical homework 2.
© 2005, it - instituto de telecomunicações. Todos os direitos reservados. Gerhard Maierbacher Scalable Coding Solutions for Wireless Sensor Networks IT.
Copyright 2008 Koren ECE666/Koren Part.6a.1 Israel Koren Spring 2008 UNIVERSITY OF MASSACHUSETTS Dept. of Electrical & Computer Engineering Digital Computer.
15-853Page :Algorithms in the Real World Error Correcting Codes I – Overview – Hamming Codes – Linear Codes.
Mario Vodisek 1 HEINZ NIXDORF INSTITUTE University of Paderborn Algorithms and Complexity Erasure Codes for Reading and Writing Mario Vodisek ( joint work.
1 How Many Packets Can We Encode? - An Analysis of Practical Wireless Network Coding Jerry Le, John C.S. Lui, Dah Ming Chiu Chinese University of Hong.
1 Solid State Storage (SSS) System Error Recovery LHO 08 For NASA Langley Research Center.
Redundant Array of Inexpensive Disks aka Redundant Array of Independent Disks (RAID) Modified from CCT slides.
Click to edit Master title style Click to edit Master text styles –Second level Third level –Fourth level »Fifth level 1 Today’s Topics How information.
Distributed Storage Allocations for Optimal Delay Derek Leong 1, Alexandros G. Dimakis 2, Tracey Ho 1 1 California Institute of Technology 2 University.
Digital Logic Lecture 4 Binary Codes The Hashemite University Computer Engineering Department.
1 Forward Error Correction in Sensor Networks Jaein Jeong, Cheng-Tien Ee University of California, Berkeley.
Quine-McCluskey (Tabular) Minimization Two step process utilizing tabular listings to: Identify prime implicants (implicant tables) Identify minimal PI.
Error Coding Transmission process may introduce errors into a message.  Single bit errors versus burst errors Detection:  Requires a convention that.
Notes 5IE 3121 Knapsack Model Intuitive idea: what is the most valuable collection of items that can be fit into a backpack?
1 Network Coding and its Applications in Communication Networks Alex Sprintson Computer Engineering Group Department of Electrical and Computer Engineering.
Chapter 7: Sorting Algorithms Insertion Sort. Sorting Algorithms  Insertion Sort  Shell Sort  Heap Sort  Merge Sort  Quick Sort 2.
ReiserFS Hans Reiser
A Cost-based Heterogeneous Recovery Scheme for Distributed Storage Systems with RAID-6 Codes Yunfeng Zhu 1, Patrick P. C. Lee 2, Liping Xiang 1, Yinlong.
Array BP-XOR Codes for Reliable Cloud Storage Systems Yongge Wang UNC Charlotte, USA IEEE ISIT(International Symposium on Information Theory)
1 Biometric Databases. 2 Overview Problems associated with Biometric databases Some practical solutions Some existing DBMS.
Coding and Algorithms for Memories Lecture 14 1.
Properties of the Trigonometric Functions
The concept of RAID in Databases By Junaid Ali Siddiqui.
Operand Addressing And Instruction Representation Cs355-Chapter 6.
Part 1: Overview of Low Density Parity Check(LDPC) codes.
Multi-Valued Neurons and Multilayer Neural Network based on Multi-Valued Neurons MVN and MLMVN 1.
Coding and Algorithms for Memories Lecture 13 1.
1 Channel Equalization for STBC- Encoded Cooperative Transmissions with Asynchronous Transmitters Xiaohua (Edward) Li, Fan Ng, Juite Hwu, Mo Chen Department.
1 Reliability-Based SD Decoding Not applicable to only graph-based codes May even help with some algebraic structure SD alternative to trellis decoding.
Seminar On Rain Technology
Technical Seminar II Implementation of
SEMINAR TOPIC ON “RAIN TECHNOLOGY”
A Tale of Two Erasure Codes in HDFS
The Variable-Increment Counting Bloom Filter
Rate 7/8 LDPC Code for 11ay Date: Authors:
Rate 7/8 (1344,1176) LDPC code Date: Authors:
Sequence Alignment 11/24/2018.
Xiaoyang Zhang1, Yuchong Hu1, Patrick P. C. Lee2, Pan Zhou1
Dr. Zhijie Huang and Prof. Hong Jiang University of Texas at Arlington
Information Redundancy Fault Tolerant Computing
Use ECP, not ECC, for hard failures in resistive memories
Erasure Correcting Codes for Highly Available Storage
U A B II III I IV 94.
Presentation transcript:

More Codes Never Enough

2 EVENODD Code Basics of EVENODD code  each storage node as a single column # of data nodes k = p (prime) # of total nodes n = p+2  encoding and decoding pure XOR operations  MDS property (r = 2) tolerate any 2 node failures parity nodes data nodes

3 EVENODD Code Encoding Parity node I:  Simple horizontal parity Parity node II:  Diagonal parity with adjuster complement parity Iparity II

4 EVENODD Code Encoding Parity node I:  Simple horizontal parity Parity node II:  Diagonal parity with adjuster complement adjuster parity Iparity II

5 EVENODD Encoding parity Numerical example data

6 EVENODD Code Decoding Zig-Zag decode algorithm  Recover adjuster  Find a start point  Decode iteratively adjuster node failures

r = 3

8 STAR Code Basics of STAR code  Extension of EVENODD code EVENODD code + 1 additional parity node  An efficient MDS code Tolerating up to 3 node failures (r = 3)  Encoding is straightforward parity III

9 STAR Code Decoding Decode algorithm needs to handle any 3 node failures  Special cases can be handled easily (parity failures) e.g. parity node III among the 3 failures  exact EVENODD decode  Difficult part is to deal with 3 information node failures Key to efficient decoding node failures

10 STAR Code Decoding (cont.) In the 2 nd column, the sum of any pair of cells with stride 3 can be recovered. Starting with the last cell (zero), all cells in the 2 nd column can then be recovered. The remaining problem is to recover 2 node failures  apply EVENODD decoding node failures

11 Comparison with Extended EVENODD Code Similarities  pure XOR-based  (k+3, k) MDS Differences  Extended EVENODD slope 0, 1, 2 generalize to tolerate more than triple failures  STAR slope 0, 1, -1 geometric symmetry  faster decoding

12 Decoding Complexity STAR vs. Extended EVENODD

13 Decoding Performance per node 2880 byte, XOR-based RS implementation from J. Blomer

Bit-Decoding

15 Bit-Decoding of EVENODD

16 Bit-Decoding of EVENODD

17 Bit-Decoding of EVENODD

18 Bit-Decoding of EVENODD

Optimal Updates

20 More on EVENODD Encoding Complexity Decoding Complexity Update Complexity

21 Update Complexity EVENODD: 3 – 2/p Lower Bound?

22 Update Complexity EVENODD: 3 – 2/p Lower Bound: 2 + 1/p Gap: 49%

23 EVENODD-2? Update Complexity: 2 + 1/p May be extended to r = 3 r > 4?