What is a stochastic matrix. A probability vector is a numerical vector whose entries are real n...