Webbrowser control without a form

See more:

C#

web

Hi,

I am creating a generic "backlink" checker. It works fine unless the hosts try to prevent scraping with things like "noscript" cases. My solution is to load the page in a browser control, but I can't get the dang thing to work. It starts navigating but never seems to finish.

---

Forgive me if you feel this is unethical. Feel free to ignore my question. I don't find it unethical because I will not be doing anything else other than checking if the page has a link to our own sites.

Quote:

The arms race between seo and host rages ever onward

What I have tried:

public string Window_Load(Uri url)
{
    var e = new AutoResetEvent(false);

    WebBrowser browser = new WebBrowser();

    browser.Navigating += (sender, args) =>
    {
        // hits this
        Console.WriteLine("navigating");
    };

    browser.Navigated += (sender, args) =>
    {
        // never hit
        Console.WriteLine("navigated");
    };

    browser.DocumentCompleted += (sender, args) =>
    {
        // never hit
        e.Set();

        browser.Dispose();
    };
    browser.AllowNavigation = true;

    browser.Navigate(url.ToString());

    e.WaitOne();

    return "";
}