If you try typing into your code, intellisense provides the answer:
Dim sw As New StreamWriter("F:\Temp\dummy.txt", True)
Place your cursor over the "True" and press CTRL+SHIFT+Space. Look at overload 4: string path, bool append. The text for append gives you a description of what happens when a file exists or not.