Moustafa Alzantot
Jul 10, 2017 · 1 min read

You can see what is the observation space by:
print(env.observation_space)

which prints Box(4,) which means it is a four dimensinal vector of real numbers. You can also find out what is the range of each observation variable by
env.observation_space.low and env.observation_space.high which will print the minimum and maximum values for each observation variable.

In CartPole problem, the interpretation of the observations is:
[position of cart, velocity of cart, angle of pole, rotation rate of pole]
according to https://github.com/openai/gym/issues/238

    Moustafa Alzantot

    Written by

    Computer Science PhD Student at UCLA. (http://web.cs.ucla.edu/~malzantot/)