#

dtmc

Here are 12 public repositories matching this topic...

storm

stormchecker / storm

A Modern Probabilistic Model Checker

research fault-tree markov-chain mdp model-checking model-checker ctmc pomdp dtmc

Updated Sep 13, 2026
C++

spedygiorgio / markovchain

Easy Handling Discrete Time Markov Chains

markov-model cran rcpp markov-chain r-package r-programming ctmc dtmc

Updated Aug 27, 2026
R

danieljsharpe / DISCOTRESS

🦜 DISCOTRESS 🦜 is a software package to simulate and analyse the dynamics on arbitrary Markov chains

markov-model simulation markov-chain kinetic-monte-carlo markov-chains stochastic-processes stochastic-simulation-algorithm markov-process random-walk ctmc enhanced-sampling stochastic-simulation dtmc network-dynamics rare-events k-shortest-paths markovian-dynamics continuous-time-markov-chain simulation-algorithms

Updated Jul 29, 2021
C++

danieljsharpe / DISCOTRESS_tutorials

Learn to get started using DISCOTRESS with these tutorials! Then apply to your own Markov chains in ecology 🦜🌴 economics 💸📈 biophysics 🧬🦠 and more!

markov-model simulation markov-chain tutorials kinetic-monte-carlo markov-decision-processes stochastic-simulation-algorithm markov-process random-walk ctmc discrete-event-simulation stochastic-simulation dtmc network-dynamics rare-events markovian-dynamics markov-decision-process stochastic-dynamics

Updated Sep 12, 2021
Brainfuck

stamina-storm

fluentverification / stamina-storm

STAMINA - the STochiastic Approximate Model-checker for INfinite-state Analysis, integrated with the Storm model checking engine.

markov-chain graph-theory model-checking formal-methods formal-verification ctmc transient-analysis dtmc

Updated Feb 2, 2026
C++

kholmetskii / dtmc

Type-safe discrete-time Markov chains for Haskell

haskell probability markov-chain stochastic-processes hmatrix dtmc

Updated Sep 12, 2026
Haskell

dongmingli-Ben / covid-19-modeling

COVID-19 modeling with ODEs and Markov chains. Validation results are provided, including analysis of the outbreak under the so called 'dynamic clearing' strategy.

analysis prediction ctmc ode-model dtmc covid-19

Updated Dec 16, 2021
Python

cima22 / stochastic_modelling_and_simulation

Repository that contains several Jupyter Notebooks about the course "Stocastic Modelling and Simulation".

stochastic-processes ctmc dtmc

Updated Sep 10, 2022
Jupyter Notebook

PersistentVlad / Dynamic-Topological-Magnetic-Confinement

A conceptual engineering architecture for programmable magnetic topology in plasma systems. It shifts the engineering focus from designing magnetic hardware toward designing programmable magnetic behavior.

engineering research fusion control-systems plasma-physics electromagnetism dtmc magnetic-field plasma-control magnetic-topology

Updated Jul 12, 2026

manojtharindu11 / PRISM-dtmc-model-checking

This repository contains a DTMC model written in the PRISM modeling language.

prism model-checking dtmc

Updated Mar 3, 2026

Maxacross / MarkovChainModelingSystem

Web application for modeling and visualization of DTMC and CTMC Markov chains.

visualization javascript graphviz simulation modeling probability plotly mathjax web-application markov-chains stochastic-processes ctmc dtmc

Updated May 15, 2026
JavaScript

tbc8br / dtmc-self-loop-absorption-invariance

Companion Python/NumPy code for absorption-probability invariance under transient self-loop deformation in finite absorbing DTMCs.

python reproducible-research numpy markov-chains num stochastic-processes numerical-linear-algebra dtmc absorbing-markov-chains companion-code self-loops absorption-probabilities

Updated Jun 5, 2026
Python

Add this topic to your repo

To associate your repository with the dtmc topic, visit your repo's landing page and select "manage topics."