Click here to Skip to main content
15,867,568 members
Articles / Desktop Programming / MFC
Article

Loading and parsing HTML using MSHTML. 3rd way.

Rate me:
Please Sign up or sign in to vote.
4.74/5 (19 votes)
11 May 2002CPOL4 min read 984.4K   5.8K   128   203
Explains how to load HTML code from memory and parse it using MS technologies

Introduction

First let me explain why I called the article "3rd Way". I've already seen such articles on CodeGuru, explaining how to load and parse HTML file from memory. You may ask, so why I'm writing another guide? Well, below I'll show advantages and disadvantages that I found in those ways.

First one, which is also shown in MSDN , is to load HTML code using IStream interface. You can read the article about it here. If all you want is to put a new code into your document, you should definately use this one. But if you'll try to get tags from your document after you load HTML, you will get nothing. Just because they are still in parsing and you have to create an OnDocumentComplete handler and only than start to look inside your document.

When I realized this I went to look for another way that will give me document immediately after submitting a code. And yes, I found it! You can look at the great article by Asher Kobin at CodeGuru. It uses a new interface called IMarkupServices, introduced with MS Internet Explorer 5.0. I picked this code and made my own from it and started using it.... but suddenly I saw that when I'm saving my document to disk, the BODY tag has no attributes! I worked on this problem a whole day, trying to get it working, but... nothing. When you load your HTML code from memory into document, all attributes of BODY tag are gone. Still have no idea why it is happening and will be glad if someone will tell me.

Thus I came to MSDN again and found another, third way to load and parse HTML. I was so happy, so I decided to write my first article to CodeProject about it, which you are reading now :)

Code

For those, advanced programmers, that don't want to read a whole article, I will give a hint: loading HTML code is made by write() method of IHTMLDocument2 interface.

Now I'll explain how to do this from beginning.

Headers and imports

I'll assume here, that you have a standard MFC application (such as Dialog , SDI or MDI applications). First of all you have to initialize COM, since we gonna use MSHTML COM interfaces. This can be done in InitInstance() function of your application. Remember also to uninitialize COM in your ExitInstance():

BOOL CYourApp::InitInstance()
{
	CoInitialize(NULL);
	...
}
int CYourApp::ExitInstance() 
{
	...
	CoUninitialize();
	return CWinApp::ExitInstance();
}

Now in the file you are going to use MSHTML interfaces, include mshtml.h, comdef.h (for smart pointers) and import mshtml.tlb:

#include <comdef.h>
#include <mshtml.h>
#pragma warning(disable : 4146)	//see Q231931 for explaintation
#import <mshtml.tlb> no_auto_exclude

Where do I get a document?

Now let's get a pointer to IHTMLDocument interface. How you will get it? Depends on what you already have :) If you are hosting a WebBrowser control or using CHtmlView in your application, u can call GetDocument() function in store the return value in your pointer, but I will explain how to get a 'free' document, which is not attached to any control or view. This can be done by simple call to CoCreateInstance() function:

MSHTML::IHTMLDocument2Ptr pDoc;
HRESULT hr = CoCreateInstance(CLSID_HTMLDocument, NULL, CLSCTX_INPROC_SERVER, 
                              IID_IHTMLDocument2, (void**)&pDoc);

Validate that you have a valid pointer (not NULL) and move on.

Converting your HTML code

I'll assume that you have all HTML code you want to load in some variable called lpszHTMLCode. This can be CString or any other buffer, loaded for example from file on disk. We need to prepare it before passing to MSHTML. The problem is that MSHTML function we are going to use takes only SAFEARRAY as parameter. So let's convert our string to SAFEARRAY:

SAFEARRAY* psa = SafeArrayCreateVector(VT_VARIANT, 0, 1);
VARIANT *param;
bstr_t bsData = (LPCTSTR)lpszHTMLCode;
hr =  SafeArrayAccessData(psa, (LPVOID*)&param);
param->vt = VT_BSTR;
param->bstrVal = (BSTR)bsData;

Last jump

Now we are ready to pass our SAFEARRAY to write() function. These 2 lines of code will do all dirty parsing work for you

hr = pDoc->write(psa);	//write your buffer
hr = pDoc->close();	//and closes the document, "applying" your code  

//Don't forget to free the SAFEARRAY!
SafeArrayDestroy(psa);

Of course, remember to check every your step, so your program never crush, I skipped it to keep the code simple.

Now, after all this work you have a pointer to IHTMLDocument2 interface, which gives you a lot of features, like getting particular tag, searching, inserting, replacing, deleting tag, just like you do it in JavaScript.

And remember, if you are using smart pointers (like I do here) you don't need to call Release() function, the object will be freed automatically.

"about:blank" bug workaround

Well, since we have no site "attached" to our document interface, all links (href, src) that are relative to document, will start with "about:blank" if you'll try to use IHTMLAnchorElement::href property. The way to get the exact link, as it is in HTML source, is to use IHTMLElement interface with nice function called getAttribute. Just remember that the second parameter of this function should be 2, it will tell to parser to return you text as is.

Of course same way you should work with IMG, LINK and other tags. The example project updated with this fix also. You can download it and see how I did it.

References

Ahser Kobin's article about parsing with IMarkupServices (CodeGuru)
Load HTML from Stream (MSDN)
MSHTML Reference (MSDN)
IHTMLDocument2 Reference (MSDN)

License

This article, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)


Written By
Team Leader Varonis
Israel Israel
I was born in small town Penza, Russia, in October 13th, 1975 yr. So my mother tongue is Russian. I finished the school there and learned in University, then I came to Israel and since then, I live there (or here *s*)
My profession is a C++ programmer under MS Windows platforms, but my hobby is Web development and ASP programming.

I started interesting in computers and programming somewere in 1990-1991 yrs., when my father brought home our first computer - Sinclair ZX Spectrum (he made it by himself). So I learned Basic and joined the Basic programmers club at my school (me and my friend were the only 2 guys from all school there, lol). After I finished the school (1992yr) I decided to continue my study at University and got specialization Operation Systems and Software Engineer. Although I still like my profession, but I always wanted something new, thus I learned HTML, Javascript and ASP which turned to be my hobby Smile | :)

Comments and Discussions

 
GeneralRe: Who can tell me why??? Pin
RG4-Feb-02 3:08
RG4-Feb-02 3:08 
GeneralSmart Pointers Pin
Philip Patrick4-Feb-02 4:24
professionalPhilip Patrick4-Feb-02 4:24 
GeneralRe: Smart Pointers Pin
RG4-Feb-02 5:02
RG4-Feb-02 5:02 
GeneralFunctions in MSHTML smart pointers and links Pin
Philip Patrick4-Feb-02 4:50
professionalPhilip Patrick4-Feb-02 4:50 
GeneralRe: Functions in MSHTML smart pointers and links Pin
RG4-Feb-02 6:25
RG4-Feb-02 6:25 
GeneralRe: Functions in MSHTML smart pointers and links Pin
Philip Patrick4-Feb-02 6:45
professionalPhilip Patrick4-Feb-02 6:45 
GeneralRe: Functions in MSHTML smart pointers and links Pin
RG4-Feb-02 7:02
RG4-Feb-02 7:02 
GeneralRe: Functions in MSHTML smart pointers and links Pin
4-Feb-02 8:39
suss4-Feb-02 8:39 
GeneralRe: Functions in MSHTML smart pointers and links Pin
Philip Patrick4-Feb-02 12:30
professionalPhilip Patrick4-Feb-02 12:30 
GeneralRe: Functions in MSHTML smart pointers and links Pin
4-Feb-02 20:17
suss4-Feb-02 20:17 
GeneralRe: Functions in MSHTML smart pointers and links Pin
RG4-Feb-02 20:42
RG4-Feb-02 20:42 
GeneralRe: Functions in MSHTML smart pointers and links Pin
RG4-Feb-02 6:53
RG4-Feb-02 6:53 
GeneralThanks Pin
Member 66223-Feb-02 18:12
Member 66223-Feb-02 18:12 
GeneralDemo added Pin
Philip Patrick2-Feb-02 23:00
professionalPhilip Patrick2-Feb-02 23:00 
GeneralAny questions? :) Pin
Philip Patrick1-Feb-02 11:19
professionalPhilip Patrick1-Feb-02 11:19 
GeneralRe: Any questions? :) Pin
2-Feb-02 20:17
suss2-Feb-02 20:17 
GeneralRe: Any questions? :) Pin
Philip Patrick2-Feb-02 22:58
professionalPhilip Patrick2-Feb-02 22:58 
GeneralRe: Any questions? :) Pin
2-Feb-02 23:21
suss2-Feb-02 23:21 
GeneralRe: Any questions? :) Pin
Chris Maunder3-Feb-02 0:44
cofounderChris Maunder3-Feb-02 0:44 
GeneralRe: Any questions? :) Pin
Philip Patrick3-Feb-02 0:51
professionalPhilip Patrick3-Feb-02 0:51 

General General    News News    Suggestion Suggestion    Question Question    Bug Bug    Answer Answer    Joke Joke    Praise Praise    Rant Rant    Admin Admin   

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.