Holooly Plus Logo

Question 11.2.33: Consider a random walker who moves on the integers 0, 1, .........

Consider a random walker who moves on the integers 0, 1, …, N, moving one step to the right with probability p and one step to the left with probability q =1 − p. If the walker ever reaches 0 or N he stays there. (This is the Gambler’s Ruin problem of Exercise 23.) If p = q show that the function

f(i)= i

is a harmonic function (see Exercise 27), and if p ≠ q then

f(i)= \left(\frac{q}{p} \right)^i

is a harmonic function. Use this and the result of Exercise 27 to show that the probability biN of being absorbed in state N starting in state i is

b_{iN}=\begin{cases} \frac{i}{N}, & if ~p = q,\\ \frac{(\frac{q}{p} )^i-1}{(\frac{q}{p} )^N-1}, & if ~p ≠ q.\end{cases}

For an alternative derivation of these results see Exercise 24.

The "Step-by-Step Explanation" refers to a detailed and sequential breakdown of the solution or reasoning behind the answer. This comprehensive explanation walks through each step of the answer, offering you clarity and understanding.
Our explanations are based on the best information we have, but they may not always be right or fit every situation.
The blue check mark means that this solution has been answered and checked by an expert. This guarantees that the final answer is accurate.
Learn more on how we answer questions.

Related Answered Questions

Question: 11.2.31

Verified Answer:

You can easily check that the proportion of G’s in...
Question: 11.2.27

Verified Answer:

Use the solution to Exercise 24 with w = f.
Question: 11.5.23

Verified Answer:

Assume that the chain is started in state si. Let ...
Question: 11.5.21

Verified Answer:

The transition matrix is P= \begin{matrix} ...
Question: 11.5.19

Verified Answer:

Recall that m_{ij}= \sum\limits_{j}{\frac{z...
Question: 11.5.18

Verified Answer:

Form a Markov chain whose states are the possible ...
Question: 11.5.17

Verified Answer:

We know that wZ = w. We also know that mki = (zii ...
Question: 11.5.15

Verified Answer:

If pij = pji then P has column sums 1. We have see...
Question: 11.5.13

Verified Answer:

Assume that w is a fixed vector for P. Then ...