| DTMCPack-package | Suite of functions related to discrete-time discrete-state Markov Chains | 
| DTMC | Simulation of Discrete-Time/State Markov Chain | 
| DTMCPack | Suite of functions related to discrete-time discrete-state Markov Chains | 
| FPTime | First Passage Time | 
| gr | Example Data Set: Gambler's ruin on 4 states | 
| hh | Harry the SemiPro | 
| id | Initial distribution | 
| MultDTMC | Multiple Discrete time Markov Chains | 
| statdistr | Computing Stationary Distribution |