This is just here as a test because I lose it
Term information
definition
In probability theory, a Markov model is a stochastic model that assumes the Markov property. Generally, this assumption enables reasoning and computation with the model that would otherwise be intractable. The most common Markov models and their relationships are summarized in the following table: |System state is fully observable | System state is partially observable ---------------------------------------------------------------------------------- System is autonomous | Markov chain hidden Markov model System is controlled | Markov decision process partially observable Markov decision process