Youngkwon C. answered • 12/01/15

Tutor

4.9
(8)
Knowledgeable and patient tutor with a Ph.D. in Electrical Eng.

Hi Katie,

Let S

_{i}, i = 1, 2, denote the state i.If T

_{ij}denotes the transition from S_{j}to S_{i},transition probabilities are given as follows.

Prob(T

_{11}) = 0.9 Prob(T

_{21}) = 1- Prob(T_{11}) = 1 - 0.9 = 0.1 Prob(T

_{12}) = 0.2 Prob(T

_{22}) = 1- Prob(T_{12}) = 1 - 0.2 = 0.8So, the Markovian transition matrix is

**⌈**

**0.9**

**0.2**⌉

**⌊**

**0.1**

**0.8**⌋