README.md

    pre-commit Code style: black

    Gym

    Gym is an open source Python library for developing and comparing reinforcement learning algorithms by providing a standard API to communicate between learning algorithms and environments, as well as a standard set of environments compliant with that API. Since its release, Gym's API has become the field standard for doing this.

    Gym documentation website is at https://www.gymlibrary.ml/, and you can propose fixes and changes to it here.

    Gym also has a discord server for development purposes that you can join here: https://discord.gg/nHg2JRN489

    Installation

    To install the base Gym library, use pip install gym.

    This does not include dependencies for all families of environments (there's a massive number, and some can be problematic to install on certain systems). You can install these dependencies for one family like pip install gym[atari] or use pip install gym[all] to install all dependencies.

    We support Python 3.7, 3.8, 3.9 and 3.10 on Linux and macOS. We will accept PRs related to Windows, but do not officially support it.

    API

    The Gym API's API models environments as simple Python env classes. Creating environment instances and interacting with them is very simple- here's an example using the "CartPole-v1" environment:

    import gym
    env = gym.make("CartPole-v1")
    observation, info = env.reset(seed=42, return_info=True)
    
    for _ in range(1000):
        action = env.action_space.sample()
        observation, reward, done, info = env.step(action)
    
        if done:
            observation, info = env.reset(return_info=True)
    env.close()

    Notable Related Libraries

    • Stable Baselines 3 is a learning library based on the Gym API. It is designed to cater to complete beginners in the field who want to start learning things quickly.
    • RL Baselines3 Zoo builds upon SB3, containing optimal hyperparameters for Gym environments as well as code to easily find new ones.
    • Tianshou is a learning library that's geared towards very experienced users and is design to allow for ease in complex algorithm modifications.
    • RLlib is a learning library that allows for distributed training and inferencing and supports an extraordinarily large number of features throughout the reinforcement learning space.
    • PettingZoo is like Gym, but for environments with multiple agents.

    Environment Versioning

    Gym keeps strict versioning for reproducibility reasons. All environments end in a suffix like "_v0". When changes are made to environments that might impact learning results, the number is increased by one to prevent potential confusion.

    MuJoCo Environments

    The latest "_v4" and future versions of the MuJoCo environments will no longer depend on mujoco-py. Instead mujoco will be the required dependency for future gym MuJoCo environment versions. Old gym MuJoCo environment versions that depend on mujoco-py will still be kept but unmaintained. To install the dependencies for the latest gym MuJoCo environments use pip install gym[mujoco]. Dependencies for old MuJoCo environments can still be installed by pip install gym[mujoco_py].

    Citation

    A whitepaper from when Gym just came out is available https://arxiv.org/pdf/1606.01540, and can be cited with the following bibtex entry:

    @misc{1606.01540,
      Author = {Greg Brockman and Vicki Cheung and Ludwig Pettersson and Jonas Schneider and John Schulman and Jie Tang and Wojciech Zaremba},
      Title = {OpenAI Gym},
      Year = {2016},
      Eprint = {arXiv:1606.01540},
    }

    Release Notes

    There used to be release notes for all the new Gym versions here. New release notes are being moved to releases page on GitHub, like most other libraries do. Old notes can be viewed here.

    项目简介

    A toolkit for developing and comparing reinforcement learning algorithms.

    🚀 Github 镜像仓库 🚀

    源项目地址

    https://github.com/openai/gym

    发行版本 14

    0.25.0

    全部发行版

    贡献者 384

    全部贡献者

    开发语言

    • Python 99.9 %
    • Dockerfile 0.1 %
    • Shell 0.0 %