Presentation on theme: "Sampling and monitoring the environment"— Presentation transcript:
1Sampling and monitoring the environment Marian ScottMarch 2009
2Outline Variation General sampling principles Methods of sampling Simple random samplingStratified samplingSystematic samplingHow many samples (power calculations)
3VariationNatural variation in the attribute of interest, might be due tofeeding habits if measuring sheep, rainfall patterns if measuring plantsAlso variation/ uncertainty due to analytical measurement techniques.Natural variation may well exceed the analytical uncertaintyExpect therefore that if you measure a series of replicate samples, they will vary and if there is sufficient you may be able to define the distribution of the attribute of interest.
5VariationActivity (log10) of particles (Bq Cs-137) with Normal or Gaussian density superimposed
6What is statistical sampling? Statistical sampling is a process that allows inferences about properties of a large collection of things (commonly described as the population), to be made from observations made on a relatively small number of individuals belonging to the population (the sample). In conducting statistical sampling, one is attempting to make inferences to the population.
7Statistical samplingThe use of valid statistical sampling techniques increases the chance that a set of specimens (the sample, in the collective sense) is collected in a manner that is representative of the population.Statistical sampling also allows a quantification of the precision with which inferences or conclusions can be drawn about the population.
8Statistical samplingthe issue of representativeness is important because of the variability that is characteristic of environmental measurements.Because of variability within the population, its description from an individual sample is imprecise, but this precision can be described in quantitative terms and improved by the choice of sampling design and sampling intensity (Peterson and Calvin, 1986).
9Good booksThe general sampling textbooks by Cochran (1977) and Thompson (1992),the environmental statistics textbook by Gilbert (1987), andpapers by Anderson-Sprecher et al. (1994), Crepin and Johnson (1993), Peterson and Calvin (1986), and Stehman and Overton (1994).
10Know what you are setting out to do before you start · describing a characteristic of interest (usually the average),·describing the magnitude in variability of a characteristic,·describing spatial patterns of a characteristic,mapping the spatial distribution,·quantifying contamination above a background or specified intervention level· detecting temporal or spatial trends,· assessing human health or environmental impacts of specific facilities, or of events such as accidental releases,assessing compliance with regulations
12Rules Rule 1: specify the objective what is the average concentration? are there trends in space and time?
13Rules Rule 1: specify the objective Rule 2: use your knowledge of the environmental context
14Use your scientific knowledge · the nature of the population such as the physical or biological material of interest, its spatial extent, its temporal stability, and other important characteristics,· the expected behaviour and environmental properties of the compound of interest in the population members,· the sampling unit (i.e., individual sample or specimen),the expected pattern and magnitude of variability in the observations .
15What is the population?The concept of the population is important. The population is the set of all items that could be sampled, such as all fish in a lake, all people living in the UK, all trees in a spatially defined forest, or all 20-g soil samples from a field. Appropriate specification of the population includes a description of its spatial extent and perhaps its temporal stability
16What is the sampling unit? The environmental context helps define the sampling unit. It is not practical to consider sampling units so small that their concentration cannot be easily measured. to consider extremely large sampling units, if they are too difficult to manipulate or process.A sampling unit is a unique element of the population that can be selected as an individual sample for collection and measurement.
17Sampling unitsIn some cases, sampling units are discrete entities (i.e., animals, trees), but in others, the sampling unit might be investigator-defined, and arbitrarily sized.Statistical sampling leads to a description of the sampled members of the population and inference(s) and conclusion(s) about the population as a whole.
18example Cyanotoxins in shellfish The objective here is to provide a measure (the average) of cyanotoxins in shellfish (eg mussels for human consumption) for the west coast of Scotland.Population is
19example Cyanotoxins in shellfish the population would be all mussels on the west coast.Sampling unit is
20example Cyanotoxins in shellfish the sampling unit is a single mussel or a group of musselsOne problem with this study scenario is that the population is mussels on the west coast, but the sampled population may be just those mussels large enough to be caught by the prevailing commercial fishing methods.
21RepresentativityAn essential concept is that the taking of a sufficient number of individual samples should provide a collective sample that is representative of all samples that could be taken and thus provides a true reflection of the population.A representative collective sample should reflect the population not only in terms of the attribute of interest, but also in terms of any incidental factors that affect the attribute of interest.Representativeness of environmental samples is difficult to demonstrate. Usually, representativeness is considered justified by the procedure used to select the samples.
225 step approach Define the objectives and questions to be answered Summarize the environmental context for the quantities being measured.Identify the population, including spatial and temporal extent.Select an appropriate sampling design.Document the sampling design and its rationale.
23Methods Judgemental sampling non-probability based, based only on judgment.problems include the facts that the sample may be biased, that precision cannot be quantified, and that representativeness is unknown. Thus ultimately, it is not possible to evaluate the accuracy or bias of the estimator based on such a sample. It is clear that expert knowledge, allied with probability sampling, is far superior to judgmental sampling.
24Methods Simple random sampling With simple random sampling, every sampling unit in the population has, in theory, an equal probability of being included in the sample. The resulting estimator based on such a sample will be unbiased, but it may not be efficient, in either the statistical or practical senses. Simple random sampling designs are easy to describe but may be difficult to achieve in practice.
25Population of N units-10 randomly selected 2345917232531334245465154Random digits: 5,17,23, 25, 31, 33,42, 45,46,51
26Methods Two-stage sampling This design involves definition of primary units, some fraction of which is selected randomly, then the selected primary units are sub-divided and a fraction of the sub-units are selected randomly. At each stage, the units in the design may be sub-divided and randomly selected. This design is useful for components of variation estimation, and it can be cost-effective.
27Methods Stratified sampling The population is divided into strata, each of which is likely to be more homogeneous than the entire population.In other words, the individual strata have characteristics that allow them to be distinguished from the other strata, and such characteristics are known to affect the measured attribute of interest.Some ordinary sampling method (e.g., a simple random sample or systematic sample) is used to estimate the properties of each stratum.
28Methods Stratified sampling Usually, the proportion of sample observations taken in each stratum is similar to the stratum proportion of the population, but this is not a requirement. If good estimates are wanted for rare strata that have a small occurrence frequency in the population, then the number of samples taken from the rare strata can be increased.Stratified sampling is more complex and requires more prior knowledge than simple random sampling, and estimates of the population quantities can be biased if the stratum proportions are incorrectly specified.
29Methods Systematic sampling Systematic sampling is probably the most commonly used method for field sampling. It is generally unbiased as long as the starting point is randomly selected and the systematic rules are followed with care. Line transects and two dimensional grids are specific types of systematic samples that are described in more detail in the spatial section.
30Methods Systematic sampling Systematic sampling is often more practical than random sampling because the procedures are relatively easy to implement in practice, but this approach may miss important features if the quantity being sampled varies with regular periodicity and the sampling scheme has similar periodicity.
31Population of N (9x6) units-9 systematically selected 1234561218243036424854Systematic selection: 6,12,18,24,30,36,42,48
32Methods Cluster sampling Cluster sampling is most frequently applied in situations where members of the population are found in clusters or colonies. Then, clusters of individuals are selected randomly and all individuals within each cluster are selected and measured. Another variant would involve random selection of a fraction of the individuals within a cluster. Cluster sampling is a convenient and practical design if individuals naturally group within the population. Adaptive sampling is a form of cluster sampling in which decisions are made during the survey, particularly when a cluster, such as a community or herd, are detected unexpectedly.
33Methods Double sampling A procedure known as double sampling can be useful when one characteristic may be difficult or expensive to measure but another related characteristic is simple or easy to measure. This might involve making a relatively large number of analyses using the more efficient technique, and selecting a few specimens from this sample on which to make the more expensive analysis. Then, if the two techniques yield a reasonably strong predictive relationship, one can use data from the efficient technique and the relationship to make an inference to the entire sample.
34How many samples do I need? How many samples to do what?Estimate the mean (with a specified precision)Estimate the difference between two ‘treatment’ groupsCommonly classed as power calculations
35Practical issuesQn 1: not being able to follow exactly the pre-determined statistical sampling design.Qn 2: Absence of suitable material is a common source of missing values in environmental sampling.What do we do?
36So we have sampled, what next? Two of the most common sampling objectives are:estimation of the mean, orestimation of a proportion (e.g., the unknown fraction of a population > a specified value),We consider how to achieve these under different sampling schemes
37Estimate the population mean Simple random samplingevery sampling unit in the population is expected to have an equal probability of being included in the sample. The first step requires complete enumeration of the population members. In the simple random-sampling scheme, one generates a set of random digits that are used to objectively identify the individuals to be sampled and measured.
38Estimate the population mean The sampling frameIn simple random sampling, one might assume a population of N units (N 100-cm2 areas), and use simple random sampling to select n of these units. This typically involves generation of n random digits between 1 and N, which would identify the units to sample. If a number is repeated, then one would simply generate a replacement digit.
39Estimate the population mean In the salmon example, if we imagine a fish farm cage, this would require a conceptual view of the population, as N fish numbered consecutively from 1 to N. The random digits generated then identify the fish to be sampled from the cage.From the n units sampled, suppose that the PCB concentration is measured in each sample, any one of which is denoted as yi; then the sample average, is an unbiased estimate of the population mean PCB concentration and the sample variance,s2 , would provide an unbiased estimate of the population variance:
41Sampling errorthe sampling fraction f is usually very small and given by n/N.
42Example: 137Cs contained activity (inventory) in sediment of an estuary Suppose wanted to estimate the inventory of 137Cs in the sediments of an estuary whose boundaries have been clearly defined. Assume a precise estimate of the area (m2) involved is available, so it becomes necessary to measure 137Cs areal activity densities (Bq m-2), which are multiplied by the area to estimate the contained activity in Bq.
43What is? What is the population What is the sampling unit What is the context
44Stratified random sampling In stratified sampling, the population is divided into two or more strata that individually are more homogeneous than the entire population, and a sampling method is used to estimate the properties of each stratum. Usually, the proportion of sample observations in each stratum is similar to the stratum proportion in the population.
45Stratified random sampling In stratified sampling, the population of N units is first divided into sub-populations of N1, N2,….NL units. These sub-populations are non-overlapping and together comprise the whole population. The sub-populations are called strata. They need not have the same number of units, but, to obtain the full benefit of stratification, the sub-population sizes or areas must be known. In stratified sampling, a sample is drawn from each of the strata, the size of each sample ideally in proportion to the population size or area of that stratum.
47Systematic samplingSystematic sampling differs from the methods of random sampling in terms of practical implementation and in terms of coverage. Again, assume there are N (= nk) units in the population. Then to sample n units, a unit is selected for sampling at random. Then, subsequent samples are taken at every k units. Systematic sampling has a number of advantages over simple random sampling, not least of which is convenience of collection. A systematic sample is thus spread more evenly over the population.
48Systematic samplingData from systematic designs are more difficult to analyze, especially in the most common case of a single systematic sample. Consider first the simpler case of multiple systematic samples. For example, xxx in pond sediment could be sampled using transects across the pond from one shoreline to the other. Samples are collected every 5m along the transect. The locations of the transects are randomly chosen. Each transect is a single systematic sample.
49Systematic samplingEach sample is identified by the transect number and the location along the transect. Suppose there are i = 1,.., t systematic samples (i.e. transect in the pond example) and the yij is the jth observation on the ith systematic sample for j = 1,…, ni. The average of the samples from the i’th transect is calculated.
52Number of samples needs you to state the desired limits of precision for the population inference (how precisely does one want to know the average PCB concentration, or, what size of difference is needed to be detected and with what precision?),state the inherent population variability of the attribute of interest, andderive an equation which relates the number (n) of samples with the desired precision of the parameter estimator and the degree of significance (the chance of being wrong in the inference).
53Number of samples What is the power? Power is a probability, it is the probability that we correctly conclude that the null hypothesis should be rejected. The null would say there is no difference/no effect/no trend.We want a high power
55PCBestimate the mean concentration with an estimated standard error (e.s.e.) precision of 0.1 mg kg-1. The variation of PCB in salmon flesh is Therefore, how many samples would be required? Since the e.s.e. of the sample mean is s/n, then one must solve for n, for example:
56Sample size-too bigThus this degree of improvement in precision, can only be achieved by increasing the number of samples taken to approximately This may well be impractical; therefore the only solution may be to accept a lower precision.
57Outline Spatial sampling See also Spatial modelling section Grid, transect and cluster samplingSee also Spatial modelling section
58Know what you are setting out to do before you start · describing a characteristic of interest (usually the average),·describing the magnitude in variability of a characteristic,·describing spatial patterns of a characteristic,mapping the spatial distribution,·quantifying contamination above a background or specified intervention level· detecting temporal or spatial trends,· assessing human health or environmental impacts of specific facilities, or of events such as accidental releases,assessing compliance with regulations
59Spatial samplingIn ecology, spatial data usually fall into one of two different general cases:Case 1: We assume that there is an attribute that is spatially continuous, where in principle it is possible to measure the attribute at any location defined by coordinates (x, y) over the domain or area of interest.Case 2: The attribute is not continuous through space; it exists and can be measured only at specific locations (see point processes in spatial session).
60What is the population?The concept of the population is important. The population is the set of all items that could be sampled, such as, all trees in a spatially defined forest, or all 20-g soil samples from a field. Appropriate specification of the population includes a description of its spatial extent and perhaps its temporal stability
61Sampling unitsIn some cases, sampling units are discrete entities (i.e., animals, trees), but in others, the sampling unit might be investigator-defined, and arbitrarily sized.Statistical sampling leads to a description of the sampled members of the population and inference(s) and conclusion(s) about the population as a whole.
62Random and stratified random sampling In random sampling, a random sample of locations at which the attribute is to be measured is chosen from the target population of locations. If there is knowledge of different strata over the sampling domain (such as soil type), the use of a stratified sample would be recommended and a random sample of locations would be selected within each strata. The data set is then given by the spatial coordinates of each measurement location and the measured value of the attribute at that location
63systematic samplingUsually, for systematic sampling the region is considered as being overlaid by a grid (rectangular or otherwise), and sampling locations are at gridline intersections at fixed distance apart in each of the two directions. The starting location is expected to be randomly selected.Both the extent of the grid and the spacing between locations are important. The sampling grid should span the area of interest (the population). If the goal of the study is to describe spatial correlations, the spacing between locations should be shorter than the range of the correlation.
64Quadrats and transects A quadrat is a well-defined area within which one or more samples are taken; it is usually square or rectangular in shape, with fixed dimensions. The position and orientation of the quadrat will be chosen as part of the sampling scheme.A line transect is a straight line along which samples are taken, the starting point and orientation of which will be chosen as part of the sampling scheme. In addition, the number of samples to be collected along the transect, and their spacing requires definition.
66Cluster samplingCluster sampling is particularly useful in patchy environments. The population is divided into primary units; each primary unit is divided into secondary units. In the spatial context, all the sub-units are physically close together. A sampling design (e.g., a simple random sample or a systematic design) is used to select a subset of the primary units. Then, all the sub-units in the chosen primary units are sampled.
67Cluster samplingAs an example, consider sampling lichens growing on boulders scattered in a forest. It would be difficult and perhaps impossible to enumerate all the lichens, from which to draw a simple random sample. A systematic sample would be a problem because there may not be any lichen at many of the grid points. A cluster sample then becomes a reasonable sampling method. The boulders are the primary units. The secondary units are the lichens.
68Population of N units-10 randomly selected 2345917232531334245465154Random digits: 5,17,23, 25, 31, 33,42, 45,46,51
69Random and stratified random sampling In random sampling, a random sample of locations at which the attribute is to be measured is chosen from the target population of locations. If there is knowledge of different strata over the sampling domain (such as soil type), the use of a stratified sample would be recommended and a random sample of locations would be selected within each strata.
70Stratified sampling chosen Again distances are nominal.
71Systematic samplingAgain, assume there are N (= nk) units in the population. Then to sample n units, a unit is selected for sampling at random. Then, subsequent samples are taken at every k units. Systematic sampling has a number of advantages over simple random sampling, not least of which is convenience of collection.
72Population of N (9x6) units-9 systematically selected 1234561218243036424854Systematic selection: 6,12,18,24,30,36,42,48
73Systematic samplingA systematic sample is thus spread more evenly over the population. In a spatial context such as the sediment sampling problem, this would involve laying out a regular grid of points, which are fixed distances apart in both directions within a plane surface.
74Transect sampling chosen Distances are nominal – chosen purely for convenience.
76Time and time and spaceCategory A: Temporal sampling with sampling units selected independently from the population at each time point.Category B: Temporal sampling with repeated measurements on the same sampling units.Category C: Environmental impact assessment.Category D: Spatio-temporal sampling
77Before-after-control-impact (BACI) designs One of the most plausible alternative explanations of a change is that the system changed ‘on its own’. That is, the observed change (from the before-event samples to the after-event samples) would have happened even in the absence of the known impact.One simple impact-assessment design evaluates this alternative by estimating the change at a control site presumed to be unaffected by the known event. Data are collected at four combinations of sites and times: affected and unaffected sites, each sampled before the impact and after the impact.
78Before-after-control-impact (BACI) designs The impact of the known event is estimated by the interaction between sites and times, i.e., the difference between the change at the impacted site and the change at the control site. The BACI design controls for additive temporal change unrelated to the known event.Elaborations on the basic BACI design include using multiple control sites to estimate spatial variability and spatial trends, multiple samples from the impacted area to estimate variability within the impacted area, and very frequent sampling to better characterize the nature of the impact.
79summarySampling and monitoring the environment is carried out for many purposes, including estimation of certain characteristics.Many experimental and monitoring programs have multiple objectives that must be clearly specified before the sampling program is designed, because different purposes require different sampling strategies and sampling intensities in order to be efficient, and to permit general inferences.
80summaryStatistical sampling is pertinent and necessary in ecology because of the natural stochastic variation that occurs in all environmental media, and the fact that this variation is usually much larger than variations associated with measurement uncertainties.
81case studies Rosyth (stratified sampling within an estuary) and Mururoa (sampling within an atoll)in Spatial-modelling on Thursday