We have currently standardize our test launcher under testrunner and use tox to launch our different testing environements. We advise as well to use devstack for openstack developers for development.
They have both some issues for the user/developer experience for example when there is a syntax error in the tests testrunner just spit out a big blob of characters without any other feedback.
tox on the other hand tend to breaks between releases and among different issues we currently have to pin ourself to 1.6.1, something the new developer would not necessary know.
devstack on the other hand seems to become more oriented to ensure that the gating is right and not so much anymore for developers.
This session would be to dicuss how we can improve all of this so new (and not so new) developers don't have to know about all those quirks and can develop/debug easily their code for openstack.
