Reminder: gym can be installed from the conda channel powerai, but it depends on some packages not available on defaults, so we need also conda-forge and the command to issue is:
conda install -c conda-forge -c powerai gym
It took me a while to figure out that both channels were needed, since conda was reporting some generic error on incompatibility packages.
Sources