Problem on regular Markova chain

Pakistan (E-CAT, M-CAT etc...) Board / BBA / Computer Science / Section 8.3: Regular Markova Chains