2. Actions and Transitions¶
Let denote the finite action set of each individual (small)
player
. Then
, denotes the
-copies of an individual’s action space—i.e. the set of action
profiles
. The finite set
has
number of
action profiles.
For each action profile , its associated Markov transition
probability function is a linear operator
.