binary dreams

a world of 1s and 0s

How to check the results of an XPath query against an XML document using the SmokeTester

In June 2014 my ex-colleague open sourced a smoke test tool that we began using at our previous

In June 2014 my ex-colleague open sourced a smoke test tool that we began using at our previous company. It was originally created by another colleague to be used for deployment testing. You could check a WCF service responds as expected, a database connection succeeds or the AppSettings in a configuration file are as expected.

I had a problem recently where I needed to confirm my WiX installer had successfully set the website Windows Authentication providers to "NTLM, Negotiate" - in that order. To do this I needed to create a brand new smoke test - the XMLDocumentTest.

The idea of this smoke test is to run an XPath query over an XML document. In my test I needed to check the IIS applicationHost.config file. Here is a sample of it's contents:

<?xml version="1.0" encoding="UTF-8"?>
<location path="Fake Application">
<digestAuthentication enabled="false" />
<basicAuthentication enabled="false" />
<windowsAuthentication enabled="true">
<clear />
<clear />
<add value="NTLM" />
<add value="Negotiate" />

Then if you run this XPath query over it.

/configuration/location[@path='Fake Application']/system.webServer/

You should get this result.

<add value="NTLM" />
<add value="Negotiate" />

I highly recommend the XPathBuilder application to work out your query for the smoke test.

The smoke test will look like this. Make sure the XPathQuery and ExpectedOutput elements have no line breaks, otherwise the test will not succeed.

<?xml version="1.0" encoding="utf-16"?>
<ConfigurationTestSuite xmlns:xsi="" 
<Description>This a sample smoke test of the XMLDocumentTest</Description>
<Test xsi:type="XMLDocumentTest">
<TestName>Check Windows Auth providers</TestName>
<XPathQuery>/configuration/location[@path='Fake Application']/system.webServer/
<ExpectedOutput><add value="NTLM" /><add value="Negotiate" /></ExpectedOutput>

To use the tool you can run this command. Make sure the InstallationSmokeTest.exe and smoke test file are together when running it.

InstallationSmokeTest.exe Run FakeSmokeTest.xml

At the time of posting the new test is only in the Main branch. You can download the latest Smoke Tester from CodePlex and read more information on the smoke tester here.