# Markov Process Problem

Any help is greatly appreciated. I'm completely lost.

## Answer

$$ p_k =\sum _{i=1}^n p_i \pi _{ik} = \sum _{i=1}^n p_i \alpha = \alpha \sum _{i=1}^n p_i =\alpha 1=\alpha $$ since $P$ is a probability distribution and the sum of its components is one.

The interpretation is that if the probability of reaching the state $x_k$ from any state is the constant $\alpha$, then in the stationery distribution, which is the same as the probability distribution in the long run, the probability of being in the state $x_k$ is also $\alpha$.

Martin

1.2K

The answer is accepted.

Join Matchmaticians Affiliate Marketing
Program to earn up to a 50% commission on every question that your affiliated users ask or answer.

- answered
- 634 views
- $24.00

### Related Questions

- Probability of making a full house in a poker hand
- Logic Question 𝐴∧(𝐵∨𝐶)⊢(𝐴∧𝐵)∨(𝐴∧𝐶)
- Recursive Set
- Logic quesiton A v ¬A
- Graph theory question on Euler circuit, Euler path, Hamilton circuit, and Hamilton path
- Discrete math- Range and preimage of the floor function
- Proof by induction the following recursive equation
- Mathematically determine the length and width of board required to make a box