Ok, I managed to figure it out myself. I decided to use a webclient and use Google's Api to get the website favicon:
Dim Urlh As New Uri("http://www.google.com/s2/favicons?domain=" + New Uri(Browser.Address).Host)
Dim Img As Image = New Bitmap(New IO.MemoryStream(New WebClient().DownloadData(Urlh)))
Dim Img2 As New Bitmap(Img)
Dim Img3 As Icon
Dim oIcon As Icon = Img3.FromHandle(Img2.GetHicon)
Me.Icon = oIcon
Hope this helps anyone else! ;)