edit: note, question 288805 is similar, however, I specifically am asking how does MSTest choose the default test order. Please see the rest of this question. Thank you Eilon for the link.
I was looking at a legacy MSTest project.
The tests were always running in the same order.
The order was not alphabetic and was bouncing
between methods in two *.cs TestMethod files.
I did not change the physical order of the legacy
code. I did for my convenience append "MSTest01"
to the method name of the first test, "MSTest02" to the
method name of the second test, et cetera.
To my surprise, the execution order of the TestMethod
functions changed; #3 first, #6 second, #5 third,
et cetera.
When I removed the "MSTestnn" strings from the
TestMethod function names, their execution order
changed back to the previous ordering, i.e.,
one test from the first .cs file, two tests from
the second .cs file, five tests from the first
.cs file, et cetera.
It seems that file location may not be a factor
while TestMethod function name may be a factor.
QUESTION: can anyone explain how MSTest decides on execution order of TestMethod functions?
Best Answer
I believe that MSTest executes test methods ordering them by their 'ID' (seems to be their full namespace).
I created a TestProject1 wich contains 4 unt tests (UnitTest1, ...2, ...A, ...B). Each unit test contains 5 test methods (TestMethodA, ...B, ...1, ...2, ...3). They were declared with random order inside their test classes. Now, every time I run MSTest, the tests are executed with the same order:
The only way to change that order is to rename one TestClass or a TestMethod. If for example I rename the TestMethodB, of the UnitTest1, to TestMethod4 it will be executed before TestMethodA.
To see the IDs of your test methods open the 'Test View' window from VS and then right click on a column header (e.g. Test Name) --> "Add/Remove Columns..." and add 'ID' column.