I didn't find anything in the manual, but following my nose, I found it...
Editor (menu) > Editing Settings > General (tab) > Run (section - you'll have to scroll to see it) > Output (sub-section) > Always Open Output on Play
Just untick the box and that's it.