Skip to main content

OpenAI Gym


"The team that has been maintaining Gym since 2021 has moved all future development to Gymnasium, a drop in replacement for Gym (import gymnasium as gym), and Gym will not be receiving any future updates." (Source)

Since Gym is no longer an actively maintained project, try out our integration with Gymnasium. Learn more about it here # TODO add link.

If you're using OpenAI Gym we will automatically log videos of your environment generated by gym.wrappers.Monitor. Just set the monitor_gym keyword argument to wandb.init to True or call wandb.gym.monitor().

Our gym integration is very light. We simply look at the name of the video file being logged from gym and name it after that or fall back to "videos" if we don't find a match. If you want more control, you can always just manually log a video.

The OpenRL Benchmark by CleanRL uses this integration for its OpenAI Gym examples. You can find source code (including the specific code used for specific runs) that demonstrates how to use gym with

Learn more here:

Was this page helpful?๐Ÿ‘๐Ÿ‘Ž