You could check
Request.UrlReferrer
If it's empty it's likely they navigated straight to the page, if they came from a link on another page that page will be in there and you can check that it's a valid "from" page.
Pretty bad idea in my opinion though, I'd just let them access the page any way they want.