Chapter 5: Monte Carlo Methods
Examples
- Implementation of Monte Carlo ES: Monte Carlo prediction and control with exploring starts for the 4x3 grid world.
- Monte Carlo prediction and control with exploring starts for the L-Maze.
- Monte Carlo prediction and control with exploring starts for Gymnasium’s Frozen Lake Environment.
Exercise
Implement Monte Carlo Control with an Epsilon-soft policy. Implement the algorithm and experiment with the Frozen Lake environment.
License
© 2026 Michael Hahsler. All code and documents in this repository are provided under the Creative Commons Attribution-ShareAlike 4.0 International (CC BY-SA 4.0) License.
