Click here to Skip to main content
Click here to Skip to main content

RemoteInstall: Automated Testing of Windows Installers on VMWare Infrastructure

, 24 Nov 2009
Rate this:
Please Sign up or sign in to vote.
A framework for testing Windows installers with some help from virtualization.

Introduction

RemoteInstall is a pragmatic approach to testing, and has been extremely successful at my day job. We went through several test framework iterations, and just couldn't get any automation going. We tried expensive systems and Open-Source stuff. We spent cash. We made automation a priority. It continued being a dead end.

In the meantime, we were authoring MSI installers like crazy. We had to deal with a large distributed system that was having a high deployment failure rate, a system made of many components. We had hundreds of upgrade paths, and it was clear that we needed to automate it. Seeing company automation efforts deadlocked, I decided that instead of trying yet another expensive test system, I'll have an intern write a simple tool that can leverage VMWare Infrastructure.

Background

At its inception, RemoteInstall does this:

for each virtual machine {
 for each snapshot {
  restore the snapshot
  install the software
  report success or failure
 }
}

Simple enough? You can get this behavior out of the box with a simple config file. Here's what the output looks like in CruiseControl. This tests an application for clean install and upgrades from various known snapshots.

The results were superb. We have virtually zero deployment failure in production for thousands of customers.

Then, eventually, we got pretty good at this, adding lots of useful features. If you have more than one VM, you can do this in parallel. RI integrates with build automation. It can pickup your latest installers from network shares etc.

Next, we thought: why not run some tests after each successful installation? So we added tasks and some simple integration. So you can execute JUnit or NUnit tests on the remote machine post-installation.

NUnitSample.jpg

This made it into a full blown test framework. We now author tests in C# and Java and remote them via RI to run against multiple configurations.

Implementation

The latest C# source code can be found in Subversion: https://remoteinstall.svn.codeplex.com/svn. Here're some interesting aspects of the code to get you started.

The RemoteInstall library is a modular approach that uses declarative syntax in the configuration files to drive execution.

  • An installer is a single installer, either MSI or DNI.
  • A driver does the actual install.
  • A driver task executes drivers (installers) in a sequence.
  • A task is an additional command inserted in a sequence.
  • A virtual machine power driver manages a single powered-on virtual machine snapshot.

VMWareTasks is used to control VMWare virtual machines and snapshots.

RemoteInstaller is a command-line tool that uses the RemoteInstall library to drive execution.

Using the code

Download the latest version of RemoteInstall from CodePlex. Open the help file and follow the Getting Started guide.

History

  • 2009/11/24: Initial version.

License

This article, along with any associated source code and files, is licensed under The Eclipse Public License 1.0

About the Author

dB.
Team Leader Application Security Inc., www.appsecinc.com
United States United States
Daniel Doubrovkine has been in software engineering for twelve years and is currently development manager at Application Security Inc. in New York City. He has been involved in many software ventures, including Xo3 and Vestris Inc, was a development lead at Microsoft Corp. in Redmond, and director of Engineering at Visible Path Corp. in New York City. Daniel also builds and runs a foodie website, http://www.foodcandy.com.

Comments and Discussions

 
Generaltwo questions [modified] Pinmembertottawang20-Dec-09 21:53 
GeneralRe: two questions PinmemberdB.29-Dec-09 20:37 

General General    News News    Suggestion Suggestion    Question Question    Bug Bug    Answer Answer    Joke Joke    Rant Rant    Admin Admin   

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.

| Advertise | Privacy | Mobile
Web03 | 2.8.140721.1 | Last Updated 24 Nov 2009
Article Copyright 2009 by dB.
Everything else Copyright © CodeProject, 1999-2014
Terms of Service
Layout: fixed | fluid