Recommended exercises to do on your own:

<br>
<br>

Markov Chains in Discrete Time: 1.5, 1.6, 1.8.

<br>
<br>

Markov Chains in Continuous Time: 1.12, 1.15.

<br>
<br>

Queuing Theory: 2.1, 2.2, 2.5, 2.6, 2.14.

<br>
<br>

Inventory Theory: 3.1, 3.2, 3.5, 3.6, 3.8, 3.9

<br>
<br>

Deterministic Dynamic Programming: 4.1, 4.2, 4.3

<br>
<br>

Stochastic Dynamic Programming:  4.4, 4.6, 4.8, 4.10-12

<br>
<br>


Markov Decision Processes: 5.2, 5.3, 5.4, 5.9

<br>
<br>

"Decision theory" is not a part of this course.