Separate virtual environment is the correct way to go, but only if you are comfortable enough with python, venvs, … the installer simplify this process by creating a separated virtual environment with a large number of useful package, and relevant shortcuts.
If you start mixing installer, with conda environment, with pip, you get a mess 
Mathieu