Introduction to Markov Chains

The Three Core Elements

State space: The states are finite and can only come from the state space
Memorylessness: The probability of the current choice is only affected by the previous state
Transition Matrix: The transition probability data above can be placed in a 2*2 matrix

Applications

References

【数之道 18】“What is a Markov Chain?” Understand it in just 5 minutes!_哔哩哔哩_bilibili