Markov property
Sacara informal, prosés stokastik mibanda sipat Markov if the conditional probability distribution of future states of the process, given the present state, depends only upon the current state, and conditionally independent of the past states (the path of the process) given the present state. A process with the Markov property is usually called a Markov process, and may be described as Markovian.
Mathematically, if X(t), t > 0, is a stochastic process, the Markov property states that
![{\displaystyle \mathrm {Pr} {\big [}X(t+h)=y\,|\,X(s)=x(s),s\leq t{\big ]}=\mathrm {Pr} {\big [}X(t+h)=y\,|\,X(t)=x(t){\big ]},\quad \forall h>0.}](https://wikimedia.org/api/rest_v1/media/math/render/svg/25a6129f9ba1a9ed334f56c45590db0743eabe58)
Markov processes are typically termed (time-) homogeneous if
![{\displaystyle \mathrm {Pr} {\big [}X(t+h)=y\,|\,X(t)=x(t){\big ]}=\mathrm {Pr} {\big [}X(h)=y\,|\,X(0)=x(0){\big ]},\quad \forall t,h>0,}](https://wikimedia.org/api/rest_v1/media/math/render/svg/b635c7476d943f655adcba42f3e7a55ab8f5c079)
and otherwise are termed (time-) inhomogeneous (or (time-) nonhomogeneous). Homogenéous Markov processes, usually being simpler than inhomogenéous ones, form the most important class of Markov processes.
In some cases, apparently non-Markovian processes may still have Markovian representations, constructed by expanding the concept of the 'current' and 'future' states. Let X be a non-Markovian process. Then we define a process Y, such that éach state of Y represents a time-interval of states of X, i.e. mathematically
![{\displaystyle Y(t)={\big \{}X(s):s\in [a(t),b(t)]\,{\big \}}.}](https://wikimedia.org/api/rest_v1/media/math/render/svg/09d6e381d59b76a48ff453d6a16129ba7f2fd239)
If Y has the Markov property, then it is a Markovian representation of X. In this case, X is also called a second-order Markov process. Higher-order Markov processes are defined analogously.
An example of an non-Markovian process with a Markovian representation is a moving average deret waktu.
Prosés Markov nu pangkawentarna nyaéta ranté Markov, ngan prosés-prosés séjénna ogé, kaasup gerak Brown (Ing. Brownian motion), Markovian kénéh.