A Bayesian Approach to Learning Causal networks

Slides:



Advertisements
Similar presentations
Autonomic Scaling of Cloud Computing Resources
Advertisements

UNIVERSITY OF SOUTH CAROLINA Department of Computer Science and Engineering Causal Discovery from Medical Textual Data Subramani Mani and Gregory F. Cooper.
Markov Networks Alan Ritter.
A Tutorial on Learning with Bayesian Networks
Probabilistic models Jouni Tuomisto THL. Outline Deterministic models with probabilistic parameters Hierarchical Bayesian models Bayesian belief nets.
Naïve Bayes. Bayesian Reasoning Bayesian reasoning provides a probabilistic approach to inference. It is based on the assumption that the quantities of.
Probabilistic Reasoning Bayesian Belief Networks Constructing Bayesian Networks Representing Conditional Distributions Summary.
Bayesian Network and Influence Diagram A Guide to Construction And Analysis.
BAYESIAN NETWORKS CHAPTER#4 Book: Modeling and Reasoning with Bayesian Networks Author : Adnan Darwiche Publisher: CambridgeUniversity Press 2009.
IMPORTANCE SAMPLING ALGORITHM FOR BAYESIAN NETWORKS
Introduction of Probabilistic Reasoning and Bayesian Networks
An introduction to Bayesian networks Stochastic Processes Course Hossein Amirkhani Spring 2011.
Review: Bayesian learning and inference
1 © 1998 HRL Laboratories, LLC. All Rights Reserved Construction of Bayesian Networks for Diagnostics K. Wojtek Przytula: HRL Laboratories & Don Thompson:
Regulatory Network (Part II) 11/05/07. Methods Linear –PCA (Raychaudhuri et al. 2000) –NIR (Gardner et al. 2003) Nonlinear –Bayesian network (Friedman.
1Causality & MDL Causal Models as Minimal Descriptions of Multivariate Systems Jan Lemeire June 15 th 2006.
UNIVERSITY OF SOUTH CAROLINA Department of Computer Science and Engineering CSCE 580 Artificial Intelligence Ch.6 [P]: Reasoning Under Uncertainty Sections.
Haimonti Dutta, Department Of Computer And Information Science1 David HeckerMann A Tutorial On Learning With Bayesian Networks.
Goal: Reconstruct Cellular Networks Biocarta. Conditions Genes.
1 Department of Computer Science and Engineering, University of South Carolina Issues for Discussion and Work Jan 2007  Choose meeting time.
5/25/2005EE562 EE562 ARTIFICIAL INTELLIGENCE FOR ENGINEERS Lecture 16, 6/1/2005 University of Washington, Department of Electrical Engineering Spring 2005.
Bayesian Networks Alan Ritter.
Causal Models, Learning Algorithms and their Application to Performance Modeling Jan Lemeire Parallel Systems lab November 15 th 2006.
1 Bayesian Networks Chapter ; 14.4 CS 63 Adapted from slides by Tim Finin and Marie desJardins. Some material borrowed from Lise Getoor.
Made by: Maor Levy, Temple University  Probability expresses uncertainty.  Pervasive in all of Artificial Intelligence  Machine learning 
Summary of the Bayes Net Formalism David Danks Institute for Human & Machine Cognition.
Bayesian networks Chapter 14 Section 1 – 2. Bayesian networks A simple, graphical notation for conditional independence assertions and hence for compact.
Bayesian Belief Networks. What does it mean for two variables to be independent? Consider a multidimensional distribution p(x). If for two features we.
Bayesian Learning By Porchelvi Vijayakumar. Cognitive Science Current Problem: How do children learn and how do they get it right?
第十讲 概率图模型导论 Chapter 10 Introduction to Probabilistic Graphical Models
Bayesian Networks for Data Mining David Heckerman Microsoft Research (Data Mining and Knowledge Discovery 1, (1997))
Probabilistic Reasoning ECE457 Applied Artificial Intelligence Spring 2007 Lecture #9.
Introduction to Bayesian Networks
Xiaohong Li, Graduate Research Asst. Rita Caso, Director Sam Houston State University Office of Institutional Research & Assessment.
V13: Causality Aims: (1) understand the causal relationships between the variables of a network (2) interpret a Bayesian network as a causal model whose.
Kansas State University Department of Computing and Information Sciences CIS 730: Introduction to Artificial Intelligence Lecture 28 of 41 Friday, 22 October.
Ch 8. Graphical Models Pattern Recognition and Machine Learning, C. M. Bishop, Revised by M.-O. Heo Summarized by J.W. Nam Biointelligence Laboratory,
Slides for “Data Mining” by I. H. Witten and E. Frank.
Probabilistic models Jouni Tuomisto THL. Outline Deterministic models with probabilistic parameters Hierarchical Bayesian models Bayesian belief nets.
1 CMSC 671 Fall 2001 Class #20 – Thursday, November 8.
Judea Pearl Computer Science Department UCLA ROBUSTNESS OF CAUSAL CLAIMS.
CAUSAL REASONING FOR DECISION AIDING SYSTEMS COGNITIVE SYSTEMS LABORATORY UCLA Judea Pearl, Mark Hopkins, Blai Bonet, Chen Avin, Ilya Shpitser.
Introduction on Graphic Models
Belief Networks Kostas Kontogiannis E&CE 457. Belief Networks A belief network is a graph in which the following holds: –A set of random variables makes.
Chapter 12. Probability Reasoning Fall 2013 Comp3710 Artificial Intelligence Computing Science Thompson Rivers University.
INTRODUCTION TO Machine Learning 2nd Edition
CS 2750: Machine Learning Directed Graphical Models
Reasoning Under Uncertainty: More on BNets structure and construction
Presented By S.Yamuna AP/CSE
Fault Tree Analysis Based on Dynamic Uncertain Causality Graph
Read R&N Ch Next lecture: Read R&N
Tutorial 2 Simple examples of Bayesian networks, Queries, And the stories behind them Tal Shor.
Reasoning Under Uncertainty: More on BNets structure and construction
Learning Bayesian Network Models from Data
Inconsistent Constraints
CSCI 5822 Probabilistic Models of Human and Machine Learning
Read R&N Ch Next lecture: Read R&N
A Short Tutorial on Causal Network Modeling and Discovery
A. Mancusoa,b, M. Compareb, A. Saloa, E. Ziob,c
Bayesian Networks Based on
Propagation Algorithm in Bayesian Networks
CAP 5636 – Advanced Artificial Intelligence
Bayesian Networks Independencies Representation Probabilistic
General Gibbs Distribution
An Algorithm for Bayesian Network Construction from Data
NRES 746: Laura Cirillo, Cortney Hulse, Rosie Perash
CS 188: Artificial Intelligence
Class #16 – Tuesday, October 26
Probabilistic Reasoning
Read R&N Ch Next lecture: Read R&N
Presentation transcript:

A Bayesian Approach to Learning Causal networks David Heckerman 11/22/2018 Haimonti Dutta, Department Of Computer and Information Science

Haimonti Dutta, Department Of Computer and Information Science Objectives Showing that causal networks are different from a causal ones Identification of circumstances in which methods for learning acausal networks are applicable to learning causal networks 11/22/2018 Haimonti Dutta, Department Of Computer and Information Science

Haimonti Dutta, Department Of Computer and Information Science A Causal Network is…… A directed acyclic graph where Nodes correspond to chance variables in U Non root node is a direct causal effect of its parents. 11/22/2018 Haimonti Dutta, Department Of Computer and Information Science

Causal Bayesian Networks and Influence diagrams A Causal Network : b f m s 11/22/2018 Haimonti Dutta, Department Of Computer and Information Science

Haimonti Dutta, Department Of Computer and Information Science Some new terms : Unresponsiveness. Set decision Mapping variable 11/22/2018 Haimonti Dutta, Department Of Computer and Information Science

What is an Influence Diagram ? A model for the domain U U D having a structural component probabilistic component 11/22/2018 Haimonti Dutta, Department Of Computer and Information Science

Haimonti Dutta, Department Of Computer and Information Science An Example f() b() ^ f ^b b f s ^s s(b,f) m m(s) ^m 11/22/2018 Haimonti Dutta, Department Of Computer and Information Science

Building an Influence diagram Steps involved : Add a node to the diagram corresponding to each variable in U U D Order the variables so that the unresponsiveness to D comes first. For each Xi do Add a causal mechanism node Make Xi a deterministic function of Ci U Xi(Ci)where Ci is a causal mechanism node. Finally Assess the dependencies among the variables that are unresponsive D. 11/22/2018 Haimonti Dutta, Department Of Computer and Information Science

Influence diagrams in canonical forms Conditions : Chance nodes descendents of D are decision nodes Descendents of decision nodes are deterministic nodes 11/22/2018 Haimonti Dutta, Department Of Computer and Information Science

Learning Influence diagrams Observations : Information arcs and predecessors of a utility node are not learned We learn only the relevance arc structure and the physical probability We also know the states of all the decision variables and thus have a complete data for D in every case of the data base. 11/22/2018 Haimonti Dutta, Department Of Computer and Information Science

Haimonti Dutta, Department Of Computer and Information Science Hence… The problem of learning influence diagrams for the domain U U D reduces to Learning acausal bayesian networks for U UD where decision variables are interpreted as chance variables 11/22/2018 Haimonti Dutta, Department Of Computer and Information Science

Learning Causal Networks An example : Decision to quit smoking do we get lung cancer before sixty? x y 11/22/2018 Haimonti Dutta, Department Of Computer and Information Science

Haimonti Dutta, Department Of Computer and Information Science The problem : We cannot fully observe the mapping variable y(x) 11/22/2018 Haimonti Dutta, Department Of Computer and Information Science

Haimonti Dutta, Department Of Computer and Information Science Mechanism Components What are they? 11/22/2018 Haimonti Dutta, Department Of Computer and Information Science

Decomposition of the mapping variable y(x) ŷ y 11/22/2018 Haimonti Dutta, Department Of Computer and Information Science

Component Independence Assumption that the mechanism components are independent. Y(x=1) y(x=0) x ŷ y 11/22/2018 Haimonti Dutta, Department Of Computer and Information Science

Haimonti Dutta, Department Of Computer and Information Science Another Problem The problem : Dependent Mechanisms A solution :Introduce additional domain variables in order to render mechanisms independent But…. We may not be able to observe the variables we introduce. 11/22/2018 Haimonti Dutta, Department Of Computer and Information Science

Haimonti Dutta, Department Of Computer and Information Science Learning in a causal network reduces to learning of acausal network when Mechanism Independence Component Independence and Parameter Independence 11/22/2018 Haimonti Dutta, Department Of Computer and Information Science

Learning Causal Network structure We can use prior network methodology to establish priors for causal network learning provided the following holds: Mechanism independence Component independence Parameter independence Parameter modularity 11/22/2018 Haimonti Dutta, Department Of Computer and Information Science

Haimonti Dutta, Department Of Computer and Information Science Conclusion Some important points of focus : Mechanism Independence Component Independence Parameter Independence Parameter Modularity We use the above to learn causal networks from acausal networks 11/22/2018 Haimonti Dutta, Department Of Computer and Information Science