1st International ICST Workshop on Tools for solving Structured Markov Chains

Research Article

Bounds based on lumpable matrices for partially ordered state space

  • @INPROCEEDINGS{10.1145/1190366.1190369,
        author={Ana  Busic and Jean-Michel  Fourneau},
        title={Bounds based on lumpable matrices for partially ordered state space},
        proceedings={1st International ICST Workshop on Tools for solving Structured Markov Chains},
        publisher={ACM},
        proceedings_a={SMCTOOLS},
        year={2012},
        month={4},
        keywords={Markov chains stochastic comparison lumpability},
        doi={10.1145/1190366.1190369}
    }
    
  • Ana Busic
    Jean-Michel Fourneau
    Year: 2012
    Bounds based on lumpable matrices for partially ordered state space
    SMCTOOLS
    ACM
    DOI: 10.1145/1190366.1190369
Ana Busic1,*, Jean-Michel Fourneau1,*
  • 1: PRiSM, Universite de Versailles, Saint-Quentin-en-Yvelines, 78035 Versailles, France.
*Contact email: abusic@prism.uvsq.fr, jmf@prism.uvsq.fr

Abstract

We consider the strong stochastic ("st") ordering on Markov chains whose states are naturally endowed with a partial order and we present an algorithmic derivation of lumpable upper bounding matrix.The comparison of Markov chains relies on the monotonicity property even if it is only sufficient. When the model is not monotone, we must build a monotone upper bound. Quite often the natural partial order of the model makes the problem monotone with this order. However, if we use a total order consistent with the partial one the model is often not monotone anymore for the total order. Furthermore, the monotonicity property for total order adds a lot of constraints which are irrelevant and make the bound less accurate.Here we assume that the model is monotone for the natural partial order and we must build a matrix which is larger in the strong stochastic sense and easier to solve. We build a lumpable bound and we store the lumped version to be analyzed.Lumpable upper bounding matrices may also be useful when they are associated to a total order. We can derive a bound of the Markov chain with a two phase algorithm: first we derive a lumpable upper bound from the specifications, we store the lumped version and we make this lumped matrix monotone in a second phase.