System-of-Systems Engineering - Liophant Simulation

System-of-Systems Engineering - Liophant Simulation System-of-Systems Engineering - Liophant Simulation

12.07.2015 Views

Markov Chains• A Markov Chain is a directed graph in which theedge weights represent transition probabilities,and the probabilities on the edges leaving avertex sum to 1• Markov chains are used to model stochasticprocesses– For example, a Markov chain can be used to create astochastic version of the SIR model developed usingsystem dynamics– Queuing models– Bacteria growthDeveloping Methods and Techniques for System of Systems EngineeringDr. Dimitri Mavris, dimitri.mavris@ae.gatech.edu66

Markov Chains• The transition probabilitybetween state i and j isdenoted p ij• They are typicallyrepresented in atransition matrix, wherethe rows represent thepresent state and thecolumns represent thestate at the next timestepS1p 21S2p 32p 12 p 23S3Developing Methods and Techniques for System of Systems EngineeringDr. Dimitri Mavris, dimitri.mavris@ae.gatech.edu67

Markov Chains• A Markov Chain is a directed graph in which theedge weights represent transition probabilities,and the probabilities on the edges leaving avertex sum to 1• Markov chains are used to model stochasticprocesses– For example, a Markov chain can be used to create astochastic version <strong>of</strong> the SIR model developed usingsystem dynamics– Queuing models– Bacteria growthDeveloping Methods and Techniques for <strong>System</strong> <strong>of</strong> <strong>System</strong>s <strong>Engineering</strong>Dr. Dimitri Mavris, dimitri.mavris@ae.gatech.edu66

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!