CODEWITHSUNDEEP
unit-testingvisual-studio-2010command-line
Nam G VU
Nam G VU

Reputation: 35364

How to run unit testing tests from command line?

I googled and found the below helpful references. Currently I want to run all from the command-line (for easy of execution & quickness) in cases:

  1. A specific test (ie. a test written by a method marked [TestMethod()])
  2. All tests in a class
  3. All impacted tests of the current TFS pending change of mine.
  4. All tests
  5. All tests except the ones marked as category [TestCategory("some-category")]

I'm not sure how can I write a correct command for my needs above.

References:

  1. the MSTest.exe http://msdn.microsoft.com/en-us/library/ms182487.aspx
  2. the MSTest.exe's detailed options http://msdn.microsoft.com/en-us/library/ms182489.aspx
  3. obtaining the result http://msdn.microsoft.com/en-us/library/ms182488.aspx

[Edit]

After a while, I found the below useful tips.

  1. run Visual Studio unit tests by using MSTest.exe, located at %ProgramFiles%\Microsoft Visual Studio 10.0\Common7\IDE\MSTest.exe in my case.
  2. using /testcontainer:Path\To\Your\TestProjectAssembly.dll to indicate where your tests are coded. You can specify multiple '/testcontainer' options if required.
  3. using /test:TestFilter to filter the tests to run. Note that this filter is applied to the full test method name (ie. FullNamespace.Classname.MethodName)

Upvotes: 60

Views: 81778

Answers (5)

Nir Geffen
Nir Geffen

Reputation: 106

Adding this due to errors I've encountered. To run all just use vstest.console.exe .\x64\Release\UnitTesting.dll vstest.console.exe is not deprecated so you will not need the /nologo suppression.

If needed it also has --TestCaseFilter|/TestCaseFilter:<Expression>

Upvotes: 0

Nam G VU
Nam G VU

Reputation: 35364

Currently I can have some answers for my needs:

  1. A specific test (ie. a test written by a method marked [TestMethod()])
    Use MSTest.exe /container:TheAssemblyContainingYourSpecificTest /test:TheSpecificTestName

  2. All tests in a class
    Use MSTest.exe /container:TheAssemblyContainingYourClass /test:TheClassNameWithFullNamespace
    Note that the /test: is the filter which uses the full name of the class when filtering.

The others are still left unknown. Please disscuss if you know how.

Upvotes: 18

Christopher Maddock
Christopher Maddock

Reputation: 386

For number 4. To run all tests in an assembly it's simply:

mstest /testcontainer:YourCompiledTestAssembly.dll

Upvotes: 15

Michael Freidgeim
Michael Freidgeim

Reputation: 28425

For question 

5 All tests except the ones marked as category [TestCategory("some-category")]

Use  

mstest.exe /testcontainer:yourTests.dll  /category:"!some-category"

If you need to exclude more than one category, use

  

mstest.exe /testcontainer:yourTests.dll  /category:"!group1&!group2"

Reference:  /category filter 

Upvotes: 5

Yann Trevin
Yann Trevin

Reputation: 3823

You might be interested by the Gallio bundle. It provides a free common automation platform to run your tests (MSTest, MbUnit, NUnit, xUnit, etc.) with various test runners (GUI, command line, PoSh, plugins for 3rd party tools, etc.)

In particular you may want to use Gallio.Echo which is a nice command line test runner:

Gallio.Echo

The Gallio test runners have also filtering capabilities to run a subset of your unit tests only (e.g. per category, per fixture, etc.)

Upvotes: 3

Related Questions