For that you need a favicon, just add this line. create a logo in ico format 16x16. use the path accordingly.
<link rel="shortcut icon" type="image/ico" href="favicon.ico" />
or this:
<head>
<link rel="SHORTCUT ICON" href="http://www.mydomain.com/myicon.ico"/>
<title>My Title</title>
</head>