Basically redo all of the test config into tox.ini. pytest.ini turns out to be redundant, same with setup.cfg. Long as all the tools run both standalone and within tox.ini, we're ok (everyone can read ini files).
Yay, less duplication, simplified all of this. Doing in prep of python 3.5 being added to our testing.