Jul 10, 2017 · 1 min read
You can see what is the observation space by:print(env.observation_space)
which prints Box(4,) which means it is a four dimensinal vector of real numbers. You can also find out what is the range of each observation variable by env.observation_space.low and env.observation_space.high which will print the minimum and maximum values for each observation variable.
In CartPole problem, the interpretation of the observations is:
[position of cart, velocity of cart, angle of pole, rotation rate of pole]
according to https://github.com/openai/gym/issues/238