Did you know it's even possible to make your application self-destruct ?
This can be handy if you only want to use one executable, see CodeProject article here:
How To Make Your Application Delete Itself Immediately[
^]
There is even another method: rename the running exe so the new exe can be placed, strangely enough this is allowed by Windows.
But if you are satisfied with your current solution, then there is no need for such dirty tricks of course !