pytest 4 broke the old version of pytest-random-order we were using, since the newer versions of pytest-random-order don't work with py2. I solved this by creating separate requirements files for py2 and py3.