executable program and an installer

Make a release executable and make sure you package with appropriate dll dependencies.

You can use dependency walker to figure out if there's any external dependencies.
http://wiki.imacros.net/Dependency_Walker[^]
http://download.cnet.com/Dependency-Walker/3000-2086_4-10052198.html[^]

At my company we use NSIS

http://nsis.sourceforge.net/Main_Page[^]

It use script to create an installation file and you can package all sorts of things in with it.
We use it for most of our tools so that they can be configured in the right way. Also you can create uninstall scripts so that users can remove it before installing a newer version of your software.