1 ECE 776 Project Information-theoretic Approaches for Sensor Selection and Placement in Sensor Networks for Target Localization and Tracking Renita Machado

2 Wireless sensor networks and their applications Wireless sensor networks (WSNs) are networks of large number of nodes deployed over a region to sense, gather and process data about their environment. The self organizing capabilities of WSNs enable their use in applications ranging from surveillance, ecology monitoring, bio- monitors and various other applications for developing smart environments.

3 Key challenges in WSNs Performance measures Coverage Connectivity Optimal redundancy Reliability of network operation Constraints Power limited nodes Economic constraints for dense deployments

4 Application: Target localization and tracking In localization/ tracking, each sensor updates the probability distribution of the target location estimation. Each observation reduces the uncertainty about target location or equivalently, gains information about the target location.

5 Preliminaries and problem formulation Given that we have the Prior target location distribution p (x) Set of candidate sensors for selection S Locations of candidate sensors x i Observation models of candidate sensors p (z i |x) Find The sensor whose observation minimizes the expected conditional entropy of the posterior target location distribution, i.e.  Equivalently, observation of this sensor maximizes the expected reduction of the target location entropy

6 Entropy difference in minimizing the uncertainty of localization Reduction of localization uncertainty attributable to a sensor depends on the difference between A. Entropy of noise free sensor observation B. Entropy of that sensor observation model corresponding to the true target location

7 A. Sensor observation model Sensor observation model corresponding to the true target location  Probability distribution of the sensor observation conditioned on true target location  Incorporates observation error from all sources, including Target Signal modeling error in estimation algorithm used by the sensor Inaccuracy of the sensor hardware Amount of uncertainty in sensor observation model may depend on the target location.

8 Determination of the sensor observation model Since true target location is unknown during the process of target localization and tracking, we have to use an estimated target location to approximate the true target location to determine the sensor observation model.

9 Single-modal target location For a single model target location distribution p(x) that has a single peak, we can use the maximum likelihood estimate (MLE) estimate of the target location x’ to estimate the true target location and the approximate sensor observation model is When p(x) is a single-modal distribution, H(Z i |x’) is the entropy of the sensor observation model for the most likely target location estimate x’.

10 Multimodal target location distribution For a multimodal target location distribution p(x), viz., x’ (m), m=1, 2…M, the entropy of the observation model of sensor i can be approximated by a weighted average as follows When p(x) is a multi-modal distribution, the entropy of the sensor observation model is averaged over all target locations with local maximum likelihood.

11 Relationship of H (Z i |x) to H(Z i |x’) H (Z i |x) is actually the entropy of the sensor observation model averaged over all possible target locations. When the entropy of the sensor observation model H(Z i |x) changes slowly with respect to the target location x, H(Z i |x’) reasonably approximates H (Z i |x).

12 B. Noise free sensor observation Noise free sensor observation  No error is introduced in the sensor observation Let Z i v = noise-free observation of sensor i. Z i v assumes no randomness in the process of observation regarding the target location. Hence it is a function of target location X and sensor location x i. The target location X is a random variable, sensor location x i is a deterministic quantity. Hence the noise free sensor observation is a random variable.

13 Distribution of the noise free sensor observation The target location X could be three-dimensional. The noise-free sensor observation Z i v could be two-dimensional. The distribution of the noise-free sensor observation Z i v is where the observation perspective of sensor i largely depends on the sensor location x i.

14 Computing the noise free sensor observation distribution and its entropy Let X be the set of target location grid values with non-trivial probability density, Let Z be the set of noise-free sensor observation grid values of non-trivial probability density For each grid point z i v є Z, initialize p(z i v ) to zero; For each grid point x є X, the corresponding grid point z i v є Z is calculated using Z i v = f (X, x i ) The probability is updated as p (z i v )= p (z i v ) + p (x) Normalize p (z i v ) to make the total probability of Z to be 1. From p (z i v ), we calculate the noise-free sensor observation entropy H(Z i v ).

15 Relationship of H(Z i v ) to H(Z i ) H(Z i ) is the entropy of the predicted sensor observation distribution, The predicted sensor observation distribution p(Z i ) becomes the noise-free sensor observation p(z i v ) when the sensor observation model p(z i |x) is deterministic without any uncertainty. The uncertainty in the sensor observation model p(z i |x) makes the predicted sensor observation entropy H(Z i ) larger than the noise-free sensor observation entropy H(Z i v ).

16 Since and Thus, the sensor with the maximum entropy difference probably also has the maximum mutual information. When the sensor observation model has only a small amount of uncertainty, Approximations to the mutual-information calculation

17 Why not select the mutual information I(X;Z i )? For target location X and the predicted sensor observation Z i The target location could be 3-dimensional and the sensor observation could be 2-dimensional. Then I(X;Zi) could be a complex integral in the joint state space of 5 dimensions. Thus, the total cost to select one of K candidate sensors is O(n 5 ).

18 Complexity of the entropy approach H(Z i v ) can be computed from p(z i v ) with complexity O(n 2 ) Computing H(Z i |x’) (from single and multi-modal) distributions also requires complexity of O(n 2 ). Thus the cost to compute the entropy difference for one candidate sensor is O(n 3 ). Thus the total cost to select one sensor out of K candidate sensors is O(n 3 ).

19 Reduction in complexity The computational complexity of the mutual information approach is greater than that of the entropy difference approach. With power constraints and processing complexity constraints, the entropy difference approach fares better than the mutual information approach for selecting a sensor for target localization.

20 Results TDOA sensors TDOA, range and DOA sensors

21 Conclusions The entropy difference approach is simpler to calculate than the mutual information criterion for sensor selection. A sub-optimal sensor can be selected without retrieving sensor data. Reference H.Wang, K.Yao and D.Estrin, “Information-theoretic approaches for sensor selection and placement in sensor networks for target localization and tracking”, CENS Technical Report #52, 2005.