Chapter 5: Monte Carlo Methods
Examples: MC Exploring Starts
- Implementation: Monte Carlo prediction and control with exploring starts for the 4x3 grid world.
- Experiments: Monte Carlo prediction and control with exploring starts for the L-Maze.
- Experiments: Monte Carlo prediction and control with exploring starts for Gymnasium’s Frozen Lake Environment.
Exercise: MC with an Epsilon-soft Policy
Implement Monte Carlo Control with an epsilon-soft policy. Implement the algorithm and experiment with the Frozen Lake environment.
License
© 2026 Michael Hahsler. All code and documents in this repository are provided under the Creative Commons Attribution-ShareAlike 4.0 International (CC BY-SA 4.0) License.