Download presentation

Presentation is loading. Please wait.

Published bySydney Terry Modified over 3 years ago

1
Introduction of Markov Chain Monte Carlo Jeongkyun Lee

2
Usage Why MCMC is called MCMC MCMC methods Appendix Reference Contents 2

3
Goal : 1) Estimate an unknown target distribution (or posterior) for a complex function, or 2) draw samples from the distribution. 1. Simulation Draw samples from a probability governed by a system. 2. Integration / computing Integrate or compute a high dimensional function 3. Optimization / Bayesian inference Ex. Simulated annealing, MCMC-based particle filter 4. Learning MLE learning, unsupervised learning Usage 3

4
Why MCMC is called MCMC 4

5
5

6
3. Markov Chain Monte Carlo Construct a Markov Chain representing a target distribution. http://www.kev-smith.com/tutorial/flash/markov_chain.swf http://www.kev-smith.com/tutorial/flash/markov_chain.swf Why MCMC is called MCMC 6 …

7
MCMC Methods 7 MetropolisMetropolis-Hastings

8
MCMC Methods 8

9
9

10
3. Reversible Jump(or trans-dimensional) MCMC When the dimension of the state is changed, Additionally consider a move type. MCMC Methods 10

11
1. Markov Chain property Stationary distribution (or detailed balance) Irreducible (all pi > 0) Aperiodic Appendix 11

12
2. MH sampling as a Markov Chain The transition probability kernel in the MH algorithm Thus, if the MH kernel satisfies then the stationary distribution from this kernel corresponds to draws from the target distribution. Appendix 12

13
2. MH sampling as a Markov Chain Appendix 13

14
http://vcla.stat.ucla.edu/old/MCMC/MCMC_tutorial.htm http://vcla.stat.ucla.edu/old/MCMC/MCMC_tutorial.htm http://www.kev-smith.com/tutorial/rjmcmc.php http://www.kev-smith.com/tutorial/rjmcmc.php http://www.cs.bris.ac.uk/~damen/MCMCTutorial.htm http://www.cs.bris.ac.uk/~damen/MCMCTutorial.htm B. Walsh, “Markov Chain Monte Carlo and Gibbs Sampling”, Lecture Notes, MIT, 2004 Reference 14

15
15 Thank you!

Similar presentations

OK

Gaussian Processes to Speed up Hamiltonian Monte Carlo Matthieu Lê Journal Club 11/04/141 Neal, Radford M (2011). " MCMC Using Hamiltonian Dynamics. "

Gaussian Processes to Speed up Hamiltonian Monte Carlo Matthieu Lê Journal Club 11/04/141 Neal, Radford M (2011). " MCMC Using Hamiltonian Dynamics. "

© 2018 SlidePlayer.com Inc.

All rights reserved.

Ads by Google

Ppt on formation of a company in india Ppt on review writing tips Ppt on networking related topics of psychology Ppt on 26/11 mumbai terror attack Human rights for kids ppt on batteries Ppt on eisenmenger syndrome Ppt on soft skills communication Ppt on islam and science Ppt on class ab power amplifier Ppt on object-oriented programming with c++