Problem on regular Markova chain

Pakistan (E-CAT, M-CAT etc...) Board / BBA / Finite Mathematics / Section 8.3: Regular Markova Chains