Table of Contents:
- 1. The Poisson and Related Processes
- 2. Renewal-Reward Processes
- 3. Discrete-Time Markov Chains
- 4. Continuous-Time Markov Chains
- 5. Markov Chains and Queues
- 6. Discrete-Time Markov Decision Processes
- 7. Semi-Markov Decision Processes
- 8. Advanced Renewal Theory
- 9. Algorithmic Analysis of Queueing Models
- App. A. Useful Tools in Applied Probability
- App. B. Useful Probability Distributions
- App. C. Generating Functions
- App. D. The Discrete Fast Fourier Transform
- App. E. Laplace Transform Theory
- App. F. Numerical Laplace Inversion
- App. G. The Root-Finding Problem.
