Research Article
Bounds based on lumpable matrices for partially ordered state space
@INPROCEEDINGS{10.1145/1190366.1190369, author={Ana Busic and Jean-Michel Fourneau}, title={Bounds based on lumpable matrices for partially ordered state space}, proceedings={1st International ICST Workshop on Tools for solving Structured Markov Chains}, publisher={ACM}, proceedings_a={SMCTOOLS}, year={2012}, month={4}, keywords={Markov chains stochastic comparison lumpability}, doi={10.1145/1190366.1190369} }
- Ana Busic
Jean-Michel Fourneau
Year: 2012
Bounds based on lumpable matrices for partially ordered state space
SMCTOOLS
ACM
DOI: 10.1145/1190366.1190369
Abstract
We consider the strong stochastic ("st") ordering on Markov chains whose states are naturally endowed with a partial order and we present an algorithmic derivation of lumpable upper bounding matrix.The comparison of Markov chains relies on the monotonicity property even if it is only sufficient. When the model is not monotone, we must build a monotone upper bound. Quite often the natural partial order of the model makes the problem monotone with this order. However, if we use a total order consistent with the partial one the model is often not monotone anymore for the total order. Furthermore, the monotonicity property for total order adds a lot of constraints which are irrelevant and make the bound less accurate.Here we assume that the model is monotone for the natural partial order and we must build a matrix which is larger in the strong stochastic sense and easier to solve. We build a lumpable bound and we store the lumped version to be analyzed.Lumpable upper bounding matrices may also be useful when they are associated to a total order. We can derive a bound of the Markov chain with a two phase algorithm: first we derive a lumpable upper bound from the specifications, we store the lumped version and we make this lumped matrix monotone in a second phase.