Experiments in Behavioral Network Science: Brief Coloring and Consensus Postmortem (Revised and Updated 4/2/07) Networked Life CSE 112 Spring 2007 Michael.

Slides:



Advertisements
Similar presentations
Competitive Contagion Scoring Review Let P be the population distribution of seed choices on graph G For every seed set s that appears with non-zero probability.
Advertisements

CHAPTER 21 Inferential Statistical Analysis. Understanding probability The idea of probability is central to inferential statistics. It means the chance.
Sampling Distributions
Sampling Distributions (§ )
Probability Probability; Sampling Distribution of Mean, Standard Error of the Mean; Representativeness of the Sample Mean.
Linear Transformation and Statistical Estimation and the Law of Large Numbers Target Goal: I can describe the effects of transforming a random variable.
Networked Games: Coloring, Consensus and Voting Prof. Michael Kearns Networked Life MKSE 112 Fall 2012.
1 Analysis of Variance This technique is designed to test the null hypothesis that three or more group means are equal.
Behavioral Experiments in Networked Games Networked Life CIS 112 Spring 2008 Prof. Michael Kearns Collaborators: Stephen Judd Siddharth Suri Nick Montfort.
BHS Methods in Behavioral Sciences I
Independent Sample T-test Often used with experimental designs N subjects are randomly assigned to two groups (Control * Treatment). After treatment, the.
1.  Why understanding probability is important?  What is normal curve  How to compute and interpret z scores. 2.
Horng-Chyi HorngStatistics II41 Inference on the Mean of a Population - Variance Known H 0 :  =  0 H 0 :  =  0 H 1 :    0, where  0 is a specified.
Inferences About Process Quality
Experiments in Behavioral Network Science 2: Some Preliminary Analysis of Kings and Pawns Networked Life CSE 112 Spring 2007 Michael Kearns & Stephen Judd.
Experiments in Behavioral Network Science 2: Kings and Pawns Networked Life CSE 112 Spring 2007 Michael Kearns & Stephen Judd.
VARIABILITY. PREVIEW PREVIEW Figure 4.1 the statistical mode for defining abnormal behavior. The distribution of behavior scores for the entire population.
5-3 Inference on the Means of Two Populations, Variances Unknown
Probability and Statistics in Engineering Philip Bedient, Ph.D.
July, 2000Guang Jin Statistics in Applied Science and Technology Chapter 4 Summarizing Data.
Chapter 6 Random Error The Nature of Random Errors
Chapter 5 Sampling Distributions
Steps in Using the and R Chart
Sociology 5811: Lecture 7: Samples, Populations, The Sampling Distribution Copyright © 2005 by Evan Schofer Do not copy or distribute without permission.
1 Today Null and alternative hypotheses 1- and 2-tailed tests Regions of rejection Sampling distributions The Central Limit Theorem Standard errors z-tests.
McGraw-Hill/IrwinCopyright © 2009 by The McGraw-Hill Companies, Inc. All Rights Reserved. Chapter 7 Sampling Distributions.
Topic 5 Statistical inference: point and interval estimate
Topics: Statistics & Experimental Design The Human Visual System Color Science Light Sources: Radiometry/Photometry Geometric Optics Tone-transfer Function.
LECTURE 19 THURSDAY, 14 April STA 291 Spring
Statistical Decision Making. Almost all problems in statistics can be formulated as a problem of making a decision. That is given some data observed from.
Vegas Baby A trip to Vegas is just a sample of a random variable (i.e. 100 card games, 100 slot plays or 100 video poker games) Which is more likely? Win.
Some Analysis of Coloring Experiments and Intro to Competitive Contagion Assignment Prof. Michael Kearns Networked Life NETS 112 Fall 2014.
Chapter 6 The Standard Deviation as a Ruler and the Normal Model.
Copyright © 2010, 2007, 2004 Pearson Education, Inc. Chapter 6 The Standard Deviation as a Ruler and the Normal Model.
AP STATS: Take 10 minutes or so to complete your 7.1C quiz.
Copyright © 2009 Pearson Education, Inc. Chapter 6 The Standard Deviation as a Ruler and the Normal Model.
The Standard Deviation as a Ruler and the Normal Model
Chapter 6: Random Errors in Chemical Analysis CHE 321: Quantitative Chemical Analysis Dr. Jerome Williams, Ph.D. Saint Leo University.
Summary Five numbers summary, percentiles, mean Box plot, modified box plot Robust statistic – mean, median, trimmed mean outlier Measures of variability.
PCB 3043L - General Ecology Data Analysis. OUTLINE Organizing an ecological study Basic sampling terminology Statistical analysis of data –Why use statistics?
Statistics - methodology for collecting, analyzing, interpreting and drawing conclusions from collected data Anastasia Kadina GM presentation 6/15/2015.
Chapter 7 Probability and Samples: The Distribution of Sample Means
RESEARCH & DATA ANALYSIS
PCB 3043L - General Ecology Data Analysis.
Networked Games: Coloring, Consensus and Voting Prof. Michael Kearns Networked Life NETS 112 Fall 2013.
Week 6. Statistics etc. GRS LX 865 Topics in Linguistics.
How Do “Real” Networks Look?
Copyright © 2009 Pearson Education, Inc. 8.1 Sampling Distributions LEARNING GOAL Understand the fundamental ideas of sampling distributions and how the.
From the population to the sample The sampling distribution FETP India.
Measurements and Their Analysis. Introduction Note that in this chapter, we are talking about multiple measurements of the same quantity Numerical analysis.
Copyright © 2008 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Chapter 6 The Standard Deviation as a Ruler and the Normal Model.
Inference for distributions: - Comparing two means.
Chapter 12 Tests of Hypotheses Means 12.1 Tests of Hypotheses 12.2 Significance of Tests 12.3 Tests concerning Means 12.4 Tests concerning Means(unknown.
Uncertainty and confidence Although the sample mean,, is a unique number for any particular sample, if you pick a different sample you will probably get.
BPS - 5th Ed. Chapter 231 Inference for Regression.
Describing Data: Summary Measures. Identifying the Scale of Measurement Before you analyze the data, identify the measurement scale for each variable.
Statistical Decision Making. Almost all problems in statistics can be formulated as a problem of making a decision. That is given some data observed from.
Where Are You? Children Adults.
Networked Games: Coloring, Consensus and Voting
Networked Games: Coloring, Consensus and Voting
Chapter 5 Sampling Distributions
How Do “Real” Networks Look?
How Do “Real” Networks Look?
How Do “Real” Networks Look?
Networked Games: Coloring, Consensus and Voting
Networked Games: Coloring, Consensus and Voting
Chapter 5 Sampling Distributions
How Do “Real” Networks Look?
Sampling Distributions (§ )
Advanced Algebra Unit 1 Vocabulary
Presentation transcript:

Experiments in Behavioral Network Science: Brief Coloring and Consensus Postmortem (Revised and Updated 4/2/07) Networked Life CSE 112 Spring 2007 Michael Kearns & Stephen Judd

2 Summary of Events Held 18 coloring and 18 consensus experiments Each one had a different network structure (details withheld for now) All 18 coloring experiments globally solved –average duration ~ 35 seconds 17/18 consensus experiments globally solved –average duration ~ 62 seconds So everyone made $70 or $72 –not bad for less than a couple of hours of “work” –no promises for next round… Recall (worst-case) status of problems for centralized computation Seems it is easier to get people to disagree than to agree Let’s look at the Gallery of Consensus Art –[1] [2] [3] [4] [5][1] [2] [3] [4] [5]

3 Network Formation Model (added 4/2/07) Single parameter p (a probability) p=0: a chain of 6 cliques of size 6 each (see figure) p>0: each intra-clique edge is “rewired” with probability p: –first flip p-biased coin to decide whether to rewire –if rewiring, choose one of the endpoints to “keep” the edge –then choose new random destination vertex from entire graph Values of p used: 0, 0.1, 0.2, 0.4, Three trials for each value of p; different random network for each trial

4 S, I attach a revised figure showing how a number of macroscopic graph quantities vary as a function of p. In order to plot them all on a common scale and to compare their rates of change w.r.t. p, for each quantity I have normalized it so that the minimum value is always 0 (i.e. subtracted off the min value) and the max is always 1 (i.e. divided by the max value, after subtracting off the min). So the y-values are always between 0 and 1 and thus you can't infer absolute values, only relative. The quantities are: 1. average-case diameter (decreases with p) 2. clustering coeff (decreases with p) 3. standard deviation of the degree distribution (increases with p) 4. maximum degree (increases with p) 5. minimum degree (decreases with p) 6. ratio of the stationary random-walk probabilities of the most visited and least visited states (by standard theory, this is just the ratio of max to min degrees; increases with p) Regarding 6., note that we can think of the stationary probability of a vertex as a measure of its "centrality", so 6. is a measure of how much spread there is between the most and least central vertices. As observed before, both 1. and 2. fall off pretty rapidly with p, which argues for sampling more finely at small p. On the other hand, 3-6 have a much wider "range of response".

5 Sticking with just the consensus games for now, the attached consplot.jpeg shows a single curve for each consensus game. The curve shows what fraction of players at any given time are playing the color that ended up being the "winning" color. You can see that many of the games have extremely rapid adoption of the winning color, while others involve quite a long time and lots of "wandering".

6 S., I am attaching a revision/revisitation of a plot I sent you in the very first results following the experiments. It shows the average experiment duration (so exactly one of these is at 180 secs, all others completed before) vs. p for both coloring and consensus on the same plots… …Digging a little deeper, I compared the completion times of coloring experiments for p = 0, 0.1, 0.2 to those for p = 0.4, 0.6, 1.0. These two sets of completion times pass a two-sample, unpaired, unequal variance t-test for different means at the P = level of statistical significance, beating the magic standard of 0.05 (i.e. it is a reportable result by scientific conventions). So there are significant structural effects on coloring performance. By the way, note that the "flattening" of both curves beyond p=0.4 nicely justifies our spacing of p-values, which recall we did based on most of the "action" in various structural measures (diameter, clustering coeff, etc.) was at smaller values of p. Nice to see that thesame seems to hold true of the collective performance.