I apologize for my heaviness as I am a Mathematica novice. Is there a kind soul who can tell me how to draw diagrams like those shown on page 158, 160 and 161 of this document.Chaine de Markov
I oversee several plotting examples unsuccessfully.
Here's an answer straight from the documentation for
which graphs a fourth order Markov chain with the specified transition matrix and initial state 3. The colors occur because some of the states (1 and 2) are transient and some are absorbing (in this case, state 4). You can customize the appearance of the graph by looking at the help file for