This bug seems to have been fixed somewhere between versions 4.0 and 4.6 of the framework. The following code fails in .NET 3.5, but works as expected in 4.6 on my machine:
var address = new MailAddress("name.@outlook.com");
If you need to support this type of address, it seems your only option is to upgrade to a more recent version of the .NET Framework.