Download presentation

Presentation is loading. Please wait.

Published bySavanah Jess Modified over 3 years ago

1
On the k-Independence Required by Linear Probing and Minwise Independence Mihai P ă trașcuMikkel Thorup ICALP10

2
Linear Probing faczmj insert(x) h(x) [Knuth63] E[ time of one operation ] = O(1) birth of algorithm analysis But assumes h is a truly random function not an algorithm, but a heuristic

3
Implementable Hash Functions k-independence [Wegman, Carter FOCS79] As we draw h from a family H : uniformity: ( ) x U, h(x) uniform in [b] independence:( ) x 1, …, x k U,h(x 1 ), …, h(x k ) i.i.d. Possible implementation: let U = prime field draw a 0, …, a k-1 U randomly h(x) = ( a k-1 x k-1 + … + a 1 x + a 0 ) mod b

4
Understanding Linear Probing [Pagh, Pagh, Ružić STOC07]5-independence suffices! Let N(v) = # leafs under v = 2 level(v) faczm v Dangerous if ¾ N(v) elements under it

5
Understanding Linear Probing Main Lemma: If h(x) is in a run of length 2 k level k-1 ancestor or a sibling must be dangerous ****** h(x) insert(x) One of these must be dangerous

6
Understanding Linear Probing Look at construction time = time to insert n elements Main lemma construction time Σ dangerous v [N(v)] 2 E[construction time] Σ v [N(v)] 2 · Pr[v dangerous] 2-independence Chebyshev bound Pr[v dangerous] 1/N(v) E[construction time] Σ v N(v) = O(n lg n) Just a classic balls-in-bins analysis!

7
Understanding Linear Probing Look at construction time = time to insert n elements Main lemma construction time Σ dangerous v [N(v)] 2 E[construction time] Σ v [N(v)] 2 · Pr[v dangerous] 4-independence 4 th moment bound Pr[v dangerous] 1/[N(v)] 2 E[construction time] Σ v O(1) = O(n) Just a classic balls-in-bins analysis!

8
Understanding Linear Probing k=2k=3k=4k=5 Construction timeO(n lg n) Ω(n lg n) [PPR] O(n) Time/operation

9
Understanding Linear Probing k=2k=3k=4k=5 Construction timeO(n lg n) Ω(n lg n) [PPR] O(n) Time/operationO(lg n)O(1) One query with k-independence = keys arrange themselves by (k-1)-independence + the query hits a random location

10
Understanding Linear Probing k=2k=3k=4k=5 Construction timeΘ(n lg n)Θ(n)Θ(n) Time/operation??O(lg n)Θ(1) Do we really need one more for bounds / operation?

11
Understanding Linear Probing k=2k=3k=4k=5 Construction timeΘ(n lg n)Θ(n)Θ(n) Time/operationΘ(n)Θ(n)O(lg n)Θ(1) Do we really need one more for bounds / operation? YES. Nasty 2-independent family such that: often, ( ) run of n elements; the query often falls in this bad run.

12
Understanding Linear Probing k=2k=3k=4k=5 Construction timeΘ(n lg n)??Θ(n)Θ(n) Time/operationΘ(n)Θ(n)O(lg n)Θ(1) Could 3-independence help?

13
Understanding Linear Probing k=2k=3k=4k=5 Construction timeΘ(n lg n) Ω(n lg n) Θ(n)Θ(n) Time/operationΘ(n)Θ(n)O(lg n)Θ(1) Could 3-independence help? NO Distribute keys down a tree: n keys n/2 cost Ω (n 2 ) If Pr[Case 2] 1/n 3-independence! If Pr[Case 2] 1/n 3-independence! Case 1 0 n Case 2

14
Understanding Linear Probing k=2k=3k=4k=5 Construction timeΘ(n lg n) Θ(n) Time/operationΘ(n)Θ(n)Θ(lg n)??Θ(1) Can both phenomena hit you simultaneously?

15
Understanding Linear Probing k=2k=3k=4k=5 Construction timeΘ(n lg n) Θ(n) Time/operationΘ(n)Θ(n)Θ(lg n)O(lg n) Ω(lg n) Θ(1) Can both phenomena hit you simultaneously? YES Apply the bad 3-independent distribution only on the query path 4-independent! [Nasty proof ]

16
Minwise Independence Problem: how many packets pass through both A and B? Jaccard coefficient: |A B| / |A B| Algorithm: hash and keep min h(A), min h(B) Pr[ min h(A) = min h(B) ] = |A B| / |A B| repeat to estimate accurately A B

17
Hashing Guarantees Minwise Independence: for any S, x S Pr[ h(x) = min h(S) ] = 1 / |S| Implies: Pr[ min h(A) = min h(B) ] = |A B| / |A B| Minwise independence not easy to obtain

18
Hashing Guarantees ε-Minwise Independence: for any S, x S Pr[ h(x) = min h(S) ] = (1 ± ε) / |S| Implies: Pr[ min h(A) = min h(B) ] = (1 ± ε) |A B| / |A B| [Indyk SODA99] Any c·lg(1/ε)-independent family is ε-minwise independent Here: Some c·lg(1/ε)-independent families are not ε-minwise independent

19
What it All Means All our hash families are artificial … we understand the k-wise independence concept In practice: (a * x) >> shift More results: Ω(n lg n)-construction for linear probing terrible minwise behavior More results: Ω(n lg n)-construction for linear probing terrible minwise behavior

20
What it All Means All our hash families are artificial … we understand the k-wise independence concept In practice: (a * x) >> shift tabulation-based hashing Forthcoming paper: Simple tabulation (3-wise independent) achieves linear probing in O(1) time (+ Chernoff concentration!) o(1)-minwise independence Forthcoming paper: Simple tabulation (3-wise independent) achieves linear probing in O(1) time (+ Chernoff concentration!) o(1)-minwise independence

21
What it All Means All our hash families are artificial … we understand the k-wise independence concept In practice: (a * x) >> shift tabulation-based hashing The polynomial hash function: performance not understood but not too good in practice…

22
The End Open problem: cuckoo hashing 6-independence needed [Cohen, Kane] O(lg n)-independence suffices

Similar presentations

OK

CPSC 411, Fall 2008: Set 2 1 CPSC 411 Design and Analysis of Algorithms Set 2: Sorting Lower Bound Prof. Jennifer Welch Fall 2008.

CPSC 411, Fall 2008: Set 2 1 CPSC 411 Design and Analysis of Algorithms Set 2: Sorting Lower Bound Prof. Jennifer Welch Fall 2008.

© 2018 SlidePlayer.com Inc.

All rights reserved.

Ads by Google

Ppt on advance payment of tax Ppt on national parks and sanctuaries in india Ppt on success and failure of reconstruction Ppt on internet banking project Ppt on object oriented programming with c++ pdf Free download ppt on training and development in hrm Ppt on festivals of india download Ppt on thermal conductivity of insulating powder Ppt on mauryan Ppt on network devices used in wireless communication