Don't cry as it is very simple as 1-2-3.
You don't need to install anything in webserver, nor you have to do any huge configuration to host your Silverlight application. Do the simple basic steps like creating virtual application pointing to the Silverlight hosting path.
Then be sure that, the following MIME types are already available in your IIS Server.
If not, just follow the below link to configure your IIS to support the above MIME Types for Silverlight application.
Please "Mark As Answer" if this solves your problem and no need to cry, we are here to support you