A stochastic game combines a state space with strategic choices and probabilistic state transitions. At each stage, the current state and players' actions determine immediate payoffs and a probability distribution for the next state. A discounted, average-reward or finite-horizon rule specifies how stage rewards are aggregated.
With a single decision maker this reduces to a Markov decision process. With several players, a policy that is best against one fixed opponent may cease to be best when that opponent changes policy. A two-player zero-sum game discounted model leads to a statewise minimax Bellman equation, connecting strategic reasoning with dynamic programming.

Articles by others on the same topic (1)

A stochastic game is a generalization of a game that incorporates randomness into the decision-making process. In a stochastic game, the outcomes of players' strategies are influenced not only by their own decisions but also by external random events. These games are characterized by states, actions, transition probabilities, and payoffs. ### Key Components of Stochastic Games: 1. **States**: The game can be in various states, which may represent different conditions or configurations that influence the decisions of the players.