Skip to content
Quantoros

A process starts in state D. Each step stays in its state with probability 1/4 and switches with probability 3/4. Find…

Quant ResearchLevel: IntermediateAlternating Markov dynamics

A process starts in state D. Each step stays in its state with probability 1/4 and switches with probability 3/4. Find the probability of D after t steps.

Hints
  • Write the total-probability recurrence.
  • Subtract its fixed point.

Answer

d(t+1)=d(t)/4+3(1-d(t))/4=3/4-d(t)/2. Subtract the fixed point 1/2: d(t)-1/2=(-1/2)^t/2. Thus d(t)=1/2+(-1/2)^t/2; convergence oscillates.

Source and licence: Lehman, Leighton & Meyer — Mathematics for Computer Science (2018-06-06) · CC-BY-SA-3.0 · answer: Quantoros editorial

Related questions