Change the network of the virtual machine to your "normal" network (that's what we usually do with our VMWare virtual machines).
This solution require each VM have static IP and I am limited to only 5 static IPs. I am going to have 20 Virtual Machine on my dedicated server. I can't afford each unique static ip assign to each vm. This is wrong way of doing it. Are there any way to use static ip of main server to port remote desktop to HyperV VM seprately, rather than assign each static ip to each VM?