OpenAI Gym, a toolkit for developing and comparing machine learning algorithms, was recently opened to the public.