Approximating Countable Markov ChainsThe book, part of a trilogy covering the field of Markov processes, explains one method of approximating countable Markov chains by finite ones. Intended for use in seminars with advanced graduate students, it is written in the framework of the first book in the trilogy, Markov Chains, although it is completely independent of the second, Brownian Motion and Diffusion. The idea is to skip over the times at which the chain is outside some large, finite set of states. The technique is especially useful for dealing with instantaneous states. Many of the results are original. (Author). |
From inside the book
Results 1-3 of 78
Page 3
... Section 3 appears in ( Chung , 1960 , p . 141 ) , and in a more general context in ( Kingman , 1968 ) . It says that the transitions of a measurable Markov chain which visits each state with positive mean time are necessarily standard ...
... Section 3 appears in ( Chung , 1960 , p . 141 ) , and in a more general context in ( Kingman , 1968 ) . It says that the transitions of a measurable Markov chain which visits each state with positive mean time are necessarily standard ...
Page 64
... Sections 2 through 6 , using the theory developed in Chapter 1. In Section 7 , there are hints for dealing with the transient case . A summary can be found at the beginning of Chapter 1. The sections of this chapter are almost ...
... Sections 2 through 6 , using the theory developed in Chapter 1. In Section 7 , there are hints for dealing with the transient case . A summary can be found at the beginning of Chapter 1. The sections of this chapter are almost ...
Page 176
... section concludes with lemma ( 4 ) , which will be used in most of the constructions in the rest of the book . Section 2 establishes the basic analytic properties of standard stochastic semigroups ; these results will also be used many ...
... section concludes with lemma ( 4 ) , which will be used in most of the constructions in the rest of the book . Section 2 establishes the basic analytic properties of standard stochastic semigroups ; these results will also be used many ...
Contents
RESTRICTING THE RANGE | 1 |
INTRODUCTION TO DISCRETE TIME | 4 |
RESTRICTING THE RANGE APPLICATIONS | 64 |
Copyright | |
47 other sections not shown
Other editions - View all
Common terms and phrases
a₁ Abbreviate absorbing argument B₁ binary rational Borel chapter Claim coincides construction converges countably infinite defined empty product exponentially distributed F(1)-measurable Figure finite subset Fubini given hitting holding I-valued i₁ implies In+1 independent and exponentially integers interval of constancy joint distribution jump least Lebesgue measure Lemma Let F locally finitary Markov chain Markov property Markov with stationary Markov with transitions martingale matrix nondecreasing notation null set o-field spanned P-independent P-probability P(do P₁ Poisson process Poisson with parameter positive recurrent Prob probability triple prove pseudo-jumps q-lim quasiregular random variable restriction retracted right continuous sample functions satisfies Section sequence standard stochastic semigroup starting stationary transitions step functions stochastic matrix strictly increasing strong Markov property substochastic T₁ Theorem TJ,n visits X-scale X-time X₁ XN+1 Y₁ Z₁