Producing Data: Experiments BPS chapter 9 © 2010 W.H. Freeman and Company

Explanatory variables Hirsch and Johnston from the Smell & Taste Treatment and Research Foundation in Chicago believe that the presence of floral scent can improve a person’s learning ability in some situations. To test this hypothesis, they set up an experiment in which each of 22 subjects completed 2 sets of three pencil and paper mazes, one set while wearing a floral-scented mask. Each subject wore a floral-scented mask and an unscented mask, and the order was randomized. The researchers measured the length of time it took each subject to complete the sets of mazes. What is the explanatory variable? a) The amount of scent. b) Presence or absence of the floral scent. c) Time to complete the pencil and paper mazes. d) Whether the subject was able to complete the mazes quicker while wearing the floral-scented mask.

Response variables Hirsch and Johnston from the Smell & Taste Treatment and Research Foundation in Chicago believe that the presence of floral scent can improve a person’s learning ability in some situations. To test this hypothesis, they set up an experiment in which each of 22 subjects completed 2 sets of three pencil and paper mazes, one set while wearing a floral-scented mask. Each subject wore a floral-scented mask and an unscented mask, and the order was randomized. The researchers measured the length of time it took each subject to complete the sets of mazes. What is the response variable? a) The amount of scent. b) Presence or absence of the floral scent. c) Time to complete the pencil and paper mazes. d) Whether the subject was able to complete the mazes quicker while wearing the floral-scented mask.

Individuals Hirsch and Johnston from the Smell & Taste Treatment and Research Foundation in Chicago believe that the presence of floral scent can improve a person’s learning ability in some situations. To test this hypothesis, they set up an experiment in which each of 22 subjects completed 2 sets of three pencil and paper mazes, one set while wearing a floral-scented mask. Each subject wore a floral-scented mask and an unscented mask, and the order was randomized. The researchers measured the length of time it took each subject to complete the sets of mazes. What are the individuals? a) The masks (floral-scented or unscented). b) The 22 subjects. c) The mazes.

Control Hirsch and Johnston from the Smell & Taste Treatment and Research Foundation in Chicago believe that the presence of floral scent can improve a person’s learning ability in some situations. To test this hypothesis, they set up an experiment in which each of 22 subjects completed 2 sets of three pencil and paper mazes, one set while wearing a floral-scented mask. Each subject wore a floral-scented mask and an unscented mask, and the order was randomized. The researchers measured the length of time it took each subject to complete the sets of mazes. The researchers incorporated control/comparison by a) Giving each subject a floral-scented and an unscented mask. b) Randomly assigning half of the subjects to wear a floral-scented mask only and the other half to wear the unscented mask only. c) Giving each subject two sets of mazes.

Control (answer) Hirsch and Johnston from the Smell & Taste Treatment and Research Foundation in Chicago believe that the presence of floral scent can improve a person’s learning ability in some situations. To test this hypothesis, they set up an experiment in which each of 22 subjects completed 2 sets of three pencil and paper mazes, one set while wearing a floral-scented mask. Each subject wore a floral-scented mask and an unscented mask, and the order was randomized. The researchers measured the length of time it took each subject to complete the sets of mazes. The researchers incorporated control/comparison by a) Giving each subject a floral-scented and an unscented mask. b) Randomly assigning half of the subjects to wear a floral-scented mask only and the other half to wear the unscented mask only. c) Giving each subject two sets of mazes.

Randomization Hirsch and Johnston from the Smell & Taste Treatment and Research Foundation in Chicago believe that the presence of floral scent can improve a person’s learning ability in some situations. To test this hypothesis, they set up an experiment in which each of 22 subjects completed 2 sets of three pencil and paper mazes, one set while wearing a floral-scented mask. Each subject wore a floral-scented mask and an unscented mask, and the order was randomized. The researchers measured the length of time it took each subject to complete the sets of mazes. The researchers incorporated randomization by a) Randomly selecting the subjects to participate in the study. b) Randomly assigning half of the subjects to wear the floral-scented mask and the other half to wear an unscented mask. c) Randomly assigning the order that each subject receives the floral- scented and unscented masks.

Randomization (answer) Hirsch and Johnston from the Smell & Taste Treatment and Research Foundation in Chicago believe that the presence of floral scent can improve a person’s learning ability in some situations. To test this hypothesis, they set up an experiment in which each of 22 subjects completed 2 sets of three pencil and paper mazes, one set while wearing a floral-scented mask. Each subject wore a floral-scented mask and an unscented mask, and the order was randomized. The researchers measured the length of time it took each subject to complete the sets of mazes. The researchers incorporated randomization by a) Randomly selecting the subjects to participate in the study. b) Randomly assigning half of the subjects to wear the floral-scented mask and the other half to wear an unscented mask. c) Randomly assigning the order that each subject receives the floral-scented and unscented masks.

Replication Hirsch and Johnston from the Smell & Taste Treatment and Research Foundation in Chicago believe that the presence of floral scent can improve a person’s learning ability in some situations. To test this hypothesis, they set up an experiment in which each of 22 subjects completed 2 sets of three pencil and paper mazes, one set while wearing a floral-scented mask. Each subject wore a floral-scented mask and an unscented mask, and the order was randomized. The researchers measured the length of time it took each subject to complete the sets of mazes. The researchers incorporated replication by a) Using two masks. b) Using two sets of mazes. c) Using three mazes within each set. d) Using twenty-two subjects. e) Repeating the entire experiment a second time.

Replication (answer) Hirsch and Johnston from the Smell & Taste Treatment and Research Foundation in Chicago believe that the presence of floral scent can improve a person’s learning ability in some situations. To test this hypothesis, they set up an experiment in which each of 22 subjects completed 2 sets of three pencil and paper mazes, one set while wearing a floral-scented mask. Each subject wore a floral-scented mask and an unscented mask, and the order was randomized. The researchers measured the length of time it took each subject to complete the sets of mazes. The researchers incorporated replication by a) Using two masks. b) Using two sets of mazes. c) Using three mazes within each set. d) Using twenty-two subjects. e) Repeating the entire experiment a second time.

Variables Hirsch and Johnston from the Smell & Taste Treatment and Research Foundation in Chicago believe that the presence of floral scent can improve a person’s learning ability in some situations. To test this hypothesis, they set up an experiment in which each of 22 subjects completed 2 sets of three pencil and paper mazes, one set while wearing a floral-scented mask. Each subject wore a floral-scented mask and an unscented mask, and the order was randomized. The researchers measured the length of time it took each subject to complete the sets of mazes. If age affects whether the presence of a floral scent improves learning ability and was not included among the variables studied in the experiment, then age is a) An explanatory variable. b) A response variable. c) A lurking variable. d) Confounded with floral scent.

Experimental design Hirsch and Johnston from the Smell & Taste Treatment and Research Foundation in Chicago believe that the presence of floral scent can improve a person’s learning ability in some situations. To test this hypothesis, they set up an experiment in which each of 22 subjects completed 2 sets of three pencil and paper mazes, one set while wearing a floral-scented mask. Each subject wore a floral-scented mask and an unscented mask, and the order was randomized. The researchers measured the length of time it took each subject to complete the sets of mazes. The experimental design used is called a a) Completely randomized design. b) Randomized block design. c) Matched pairs design.

Experimental design (answer) Hirsch and Johnston from the Smell & Taste Treatment and Research Foundation in Chicago believe that the presence of floral scent can improve a person’s learning ability in some situations. To test this hypothesis, they set up an experiment in which each of 22 subjects completed 2 sets of three pencil and paper mazes, one set while wearing a floral-scented mask. Each subject wore a floral-scented mask and an unscented mask, and the order was randomized. The researchers measured the length of time it took each subject to complete the sets of mazes. The experimental design used is called a a) Completely randomized design. b) Randomized block design. c) Matched pairs design.

Statistical significance If there is a statistically significant difference between the average times to complete the mazes while wearing the floral-scented mask and the unscented mask, then the difference in average times to complete the mazes between the floral-scented mask and the unscented mask is a) Too large to be due to chance alone. b) Too small to be due to chance alone. c) So large that we can reasonably attribute it to chance. d) So small that it is likely due to chance.

Statistical significance (answer) If there is a statistically significant difference between the average times to complete the mazes while wearing the floral-scented mask and the unscented mask, then the difference in average times to complete the mazes between the floral-scented mask and the unscented mask is a) Too large to be due to chance alone. b) Too small to be due to chance alone. c) So large that we can reasonably attribute it to chance. d) So small that it is likely due to chance.

Experimental design An Austrian study investigated whether maintaining a surgery patient’s body temperature close to normal by heating the patient during surgery decreases wound infection rates. Patients included in the study were undergoing colon or rectal surgery and were randomly assigned to one of two treatment groups. In the normalthermic group, patients’ core temperatures were maintained near normal 36.5 degrees Celsius. In the hypothermic group, patients’ core temperatures were allowed to decrease to about 34.5 degrees Celsius. The design is called a a) Completely randomized design b) Randomized block design c) Matched pairs design

Experimental design (answer) An Austrian study investigated whether maintaining a surgery patient’s body temperature close to normal by heating the patient during surgery decreases wound infection rates. Patients included in the study were undergoing colon or rectal surgery and were randomly assigned to one of two treatment groups. In the normalthermic group, patients’ core temperatures were maintained near normal 36.5 degrees Celsius. In the hypothermic group, patients’ core temperatures were allowed to decrease to about 34.5 degrees Celsius. The design is called a a) Completely randomized design b) Randomized block design c) Matched pairs design

Experimental design In the previous experiment involving patients’ temperatures, both men and women were the patients. If the men and women were separately assigned to treatments, the design would be a a) Completely randomized design b) Randomized block design c) Matched pairs design

Experimental design (answer) In the previous experiment involving patients’ temperatures, both men and women were the patients. If the men and women were separately assigned to treatments, the design would be a a) Completely randomized design b) Randomized block design c) Matched pairs design

Randomized block design In a randomized block design, a block contains a) Individuals that are similar with respect to the characteristic that defines the block. b) Individuals that are assigned to the same treatment. c) Individuals that are similar with respect to the characteristic that defines the block and that are assigned to the same treatment.

Randomized block design (answer) In a randomized block design, a block contains a) Individuals that are similar with respect to the characteristic that defines the block. b) Individuals that are assigned to the same treatment. c) Individuals that are similar with respect to the characteristic that defines the block and that are assigned to the same treatment.

Randomized block design In a randomized block design a) All of the subjects are allocated at random among the treatments. b) The random assignment of individuals to treatments is carried out separately within each block. c) All the individuals within one block are randomly assigned one treatment.

Randomized block design (answer) In a randomized block design a) All of the subjects are allocated at random among the treatments. b) The random assignment of individuals to treatments is carried out separately within each block. c) All the individuals within one block are randomly assigned one treatment.

Experimental design True or false: An advantage of the randomized block design (RBD) over the completely randomized design (CRD) is that the RBD eliminates confounding between a lurking variable (blocking variable) and the response variable. a) True b) False

Experimental design (answer) True or false: An advantage of the randomized block design (RBD) over the completely randomized design (CRD) is that the RBD eliminates confounding between a lurking variable (blocking variable) and the response variable. a) True b) False

Experimental design True or false: An advantage of the randomized block design (RBD) over the completely randomized design (CRD) is that the RBD eliminates the variation associated with the blocking variable and makes detection of statistical significance easier. a) True b) False

Experimental design (answer) True or false: An advantage of the randomized block design (RBD) over the completely randomized design (CRD) is that the RBD eliminates the variation associated with the blocking variable and makes detection of statistical significance easier. a) True b) False

Problems with experiments A study claims that patients who receive surgery for intestinal cancer live much longer after treatment than patients who are treated without surgery. However, doctors operated only on patients in relatively good condition so we cannot conclude from this study that surgery lengthens intestinal cancer patients’ lives. This is an example of a) Confounding. b) A lurking variable. c) A double-blind experiment. d) The placebo effect.

Problems with experiments (answer) A study claims that patients who receive surgery for intestinal cancer live much longer after treatment than patients who are treated without surgery. However, doctors operated only on patients in relatively good condition so we cannot conclude from this study that surgery lengthens intestinal cancer patients’ lives. This is an example of a) Confounding. b) A lurking variable. c) A double-blind experiment. d) The placebo effect.

Double-blind experiments Medical experiments are often double-blind. This means that a) All individual data are kept confidential. b) Neither the subject nor the doctor/administrator knows which treatment the subject receives. c) Doctors are not allowed to decide which treatment a patient will receive; subjects are randomly assigned to treatments. d) The subjects in the control group receive a placebo treatment.

Double-blind experiments (answer) Medical experiments are often double-blind. This means that a) All individual data are kept confidential. b) Neither the subject nor the doctor/administrator knows which treatment the subject receives. c) Doctors are not allowed to decide which treatment a patient will receive; subjects are randomly assigned to treatments. d) The subjects in the control group receive a placebo treatment.

Experiments An advantage of experiments over observational studies is a) An experiment can provide evidence of cause and effect. b) An experiment can compare two or more groups. c) An experiment can include explanatory and response variables.

Experiments (answer) An advantage of experiments over observational studies is a) An experiment can provide evidence of cause and effect. b) An experiment can compare two or more groups. c) An experiment can include explanatory and response variables.

Experiments Which of the following principles of good experimentation does an observational study not incorporate? a) Control or comparison b) Random assignment to treatments c) Replication

Experiments (answer) Which of the following principles of good experimentation does an observational study not incorporate? a) Control or comparison b) Random assignment to treatments c) Replication

Experiment vs. observational study The Minnesota Study of Twins Reared Apart investigated whether similar attributes of twins are related to heredity or the influence of family environment. The researchers conducted an intense psychological and physiological assessment of 56 pairs of identical twins reared apart and several hundred identical twins reared together and compared the similarities of the twins in both groups. Is this study an experiment or an observational study? a) Experiment b) Observational study

Experiment vs. observational study (answer) The Minnesota Study of Twins Reared Apart investigated whether similar attributes of twins are related to heredity or the influence of family environment. The researchers conducted an intense psychological and physiological assessment of 56 pairs of identical twins reared apart and several hundred identical twins reared together and compared the similarities of the twins in both groups. Is this study an experiment or an observational study? a) Experiment b) Observational study