Strong, Weak and Branching Bisimulation for Transition Systems and Markov Reward Chains: A Unifying Matrix Approach [PDF]
Electronic Proceedings in Theoretical Computer Science, 2009 We first study labeled transition systems with explicit successful termination. We establish the notions of strong, weak, and branching bisimulation in terms of boolean matrix theory, introducing thus a novel and powerful algebraic apparatus.
Nikola Trčka
doaj +7 more sources
Lz-Transform Method and Markov Reward Approach for Flexible Manufacturing System Performance Evaluation [PDF]
Applied Sciences, 2019 This article presents a performance evaluation of a flexible manufacturing system (FMS), in which the system and its components can have different performance levels ranging from perfect functioning to total failure.
Wenbin Zeng +8 more
doaj +3 more sources
Markov Reward Approach and Reliability Associated Cost Model for Machine Tools Maintenance-Planning Optimization [PDF]
International Journal of Mathematical, Engineering and Management Sciences, 2019 This paper proposes a novel Reliability Associated Cost (RAC) model for machine tools throughout its lifetime that considers two different failure consequences, immediate failure and product rejections increase failure.
Zeng Wenbin +6 more
doaj +3 more sources
Individual differences in tail risk sensitive exploration using Bayes-adaptive Markov decision processes [PDF]
eLifeNovelty is a double-edged sword for agents and animals alike: they might benefit from untapped resources or face unexpected costs or dangers such as predation. The conventional exploration/exploitation tradeoff is thus colored by risk sensitivity.
Tingke Shen, Peter Dayan
doaj +2 more sources
On Non-Homogeneous Markov Reward Model to Availability and Importance Analysis for CNC Machine Tools [PDF]
International Journal of Mathematical, Engineering and Management Sciences, 2021 This paper exploits the Markov reward method to availability and importance evaluation for CNC machine tools. The presented paper regards CNC machine tools as a multi-state system that state transitions process caused by elements and subsystem’s failures
Zeng Wenbin +6 more
doaj +1 more source
Linear programming error bounds for random walks in the quarter-plane [PDF]
, 2012 We consider approximation of the performance of random walks in the quarter-plane. The approximation is in terms of a random walk with a product-form stationary distribution, which is obtained by perturbing the transition probabilities along the ...
Boucherie, Richard J. +2 more
core +21 more sources
Travel management optimization based on air pollution condition using Markov decision process and genetic algorithm (case study: Shiraz city) [PDF]
Archives of Transport, 2020 Currently, air pollution and energy consumption are the main issues in the transportation area in large urban cities. In these cities, most people choose their transportation mode according to corresponding utility including traveller's and trip’s ...
Mohammad Bagheri +4 more
doaj +1 more source
Compositional Reinforcement Learning for Discrete-Time Stochastic Control Systems
IEEE Open Journal of Control Systems, 2023 We propose a compositional approach to synthesize policies for networks of continuous-space stochastic control systems with unknown dynamics using model-free reinforcement learning (RL).
Abolfazl Lavaei +6 more
doaj +1 more source
Availability Analysis of Software Systems with Rejuvenation and Checkpointing
Mathematics, 2021 In software reliability engineering, software-rejuvenation and -checkpointing techniques are widely used for enhancing system reliability and strengthening data protection.
Junjun Zheng +2 more
doaj +1 more source
A Copula-based Markov Reward Approach to the Credit Spread in the European Union [PDF]
Applied Mathematical Finance, 2019 In this paper, we propose a methodology based on piece-wise homogeneous Markov chain for credit ratings and a multivariate model of the credit spreads to evaluate the financial risk in European Union (EU). Two main aspects are considered: how the financial risk is distributed among the European countries and how large is the value of the total risk ...
Guglielmo D’Amico +4 more
openaire +2 more sources