Don't think that you can enter markup to be displayed in javascript alert. however your may display a javascript prompt to the user i.e., through
confirm('do you want to go to this site www.abc.com');
and if the user clicks yes then you may redirect the user to the above site.
Regards
Pawan