Questions tagged [markov-decision-process]

For questions related to Markov decision processes (MDPs), which model decision making in time-varying and usually stochastic environments.

3 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
9
votes
0answers
168 views

For the solution of complex gaming are we to leave behind approximation and fixed algorithms in favor of agents?

For an evolutionary extensive form game is the use of multi-agent systems a necessity or can more traditional approximate Nash equilibria and mean-field interactions suffice? Few games can be ...
4
votes
0answers
35 views

Equilibria in two player, finite horizon, zero sum stochastic game

Suppose we have a two player, finite horizon, zero sum stochastic game (a.k.a. "competitive MDP"). The game is defined over a finite set of state $S$. At each decision epoch $t\in\{1,\dots,T\}$ (for ...
2
votes
0answers
26 views

MDP model for a unique system

Let's assume that we have a system where there are two exogenous factors, name $a$ and $b$, that can affect the system state. At each decision epoch either $a$ or $b$ occurs and it is not possible ...