Click here to Skip to main content
15,881,803 members
Articles / Desktop Programming / ATL

A Fully Featured Windows HTTP Wrapper in C++

Rate me:
Please Sign up or sign in to vote.
4.92/5 (102 votes)
22 Sep 2010CPOL3 min read 449.5K   22.5K   312   166
A fully featured and easy-to-use Windows HTTP wrapper in C++

Introduction

This is a fully featured Windows HTTP Wrapper in C++. It is a wrapper in the C++ class. It is fully featured and easy to use. You only need to include one single header file to use the wrapper.

Background

Several months ago, I posted my first article A Simple Windows HTTP Wrapper Using C++ on CodeProject. I continued to update it in the last several months and finally got the fully featured Windows HTTP Wrapper based on WinHTTP APIs in C++.

Features

  • Cookies supported
  • Proxy supported
  • GET, POST methods supported
  • Request headers customization supported
  • Disable automatic redirection supported
  • HTTPS supported
  • Receive progress supported
  • Some other features

Using the Code

The class diagram is as follows:

class.JPG

You can understand most of the functions from their names. Please refer to the examples section for some typical examples.

Examples

Simple Get Request

Get request is the most common request. Browsing a web page causes one or several Get requests.

C++
// Set URL.
WinHttpClient client(L"http://www.codeproject.com/");
 
// Send HTTP request, a GET request by default.
client.SendHttpRequest();
 
// The response header.
wstring httpResponseHeader = client.GetResponseHeader();
 
// The response content.
wstring httpResponseContent = client.GetResponseContent();

Simple Post Request

Post request usually occurs while logging in or posting a thread.

C++
WinHttpClient client(L"http://www.codeproject.com/");
 
// Set post data.
string data = "title=A_NEW_THREAD&content=This_is_a_new_thread.";
client.SetAdditionalDataToSend((BYTE *)data.c_str(), data.size());
 
// Set request headers.
wchar_t szSize[50] = L"";
swprintf_s(szSize, L"%d", data.size());
wstring headers = L"Content-Length: ";
headers += szSize;
headers += L"\r\nContent-Type: application/x-www-form-urlencoded\r\n";
client.SetAdditionalRequestHeaders(headers);
 
// Send HTTP post request.
client.SendHttpRequest(L"POST");
 
wstring httpResponseHeader = client.GetResponseHeader();
wstring httpResponseContent = client.GetResponseContent();

Getting Request's Progress

You can specify a callback function to get the request's progress.

C++
// Progress - finished percentage.
bool ProgressProc(double progress)
{
    wprintf(L"Current progress: %-.1f%%\r\n", progress);
    return true;
}
 
void ProgressTest(void)
{
    // Set URL and call back function.
    WinHttpClient client(L"http://www.codeproject.com/", ProgressProc);
    client.SendHttpRequest();
    wstring httpResponseHeader = client.GetResponseHeader();
    wstring httpResponseContent = client.GetResponseContent();
}

Specifying the User Agent

User agent is a string used by the clients to identify themselves to the web server so that the server can tell which client software you use, Internet Explorer 8, Chrome or FireFox. You can specify the user agent to pretend to be Internet Explorer 8 to fool the web server because sometimes the server only supports Internet Explorer 8.

C++
WinHttpClient client(L"http://www.codeproject.com/");
 
// Set the user agent to the same as Internet Explorer 8.
client.SetUserAgent(L"Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1;...)");
 
client.SendHttpRequest();
wstring httpResponseHeader = client.GetResponseHeader();
wstring httpResponseContent = client.GetResponseContent();

Specifying the Proxy

Sometimes, we have to connect to the web through proxies. WinHttpClient connects to the web server directly and then uses the Internet Explorer setting to connect if it fails by default. You can also specify the proxy by calling function SetProxy.

C++
WinHttpClient client(L"http://www.codeproject.com/");
 
// Set the proxy to 192.168.0.1 with port 8080.
client.SetProxy(L"192.168.0.1:8080");
 
client.SendHttpRequest();
wstring httpResponseHeader = client.GetResponseHeader();
wstring httpResponseContent = client.GetResponseContent();

Handling Cookies

A cookie (also tracking cookie, browser cookie, and HTTP cookie) is a small piece of text stored on a user's computer by a web browser. A cookie consists of one or more name-value pairs containing bits of information.

The cookie is sent as an HTTP header by a web server to a web browser and then sent back unchanged by the browser each time it accesses that server. A cookie can be used for authentication, session tracking (state maintenance), storing site preferences, shopping cart contents, the identifier for a server-based session, or anything else that can be accomplished through storing textual data (http://en.wikipedia.org/wiki/HTTP_cookie).

You can specify cookies to send by calling SetAdditionalRequestCookies and get the response cookies by calling GetResponseCookies.

C++
WinHttpClient client(L"http://www.codeproject.com/");
 
// Set the cookies to send.
client.SetAdditionalRequestCookies(L"username=jack");
 
client.SendHttpRequest();
 
// Get the response cookies.
wstring httpResponseCookies = client.GetResponseCookies();
 
wstring httpResponseHeader = client.GetResponseHeader();
wstring httpResponseContent = client.GetResponseContent();

HTTPS

C++
WinHttpClient client(L"https://www.google.com/");

// Accept any certificate while performing HTTPS request.
client.RequireValidSslCertificates(false);

client.SendHttpRequest();
wstring httpResponseHeader = client.GetResponseHeader();
wstring httpResponseContent = client.GetResponseContent();

Multiple Requests

C++
WinHttpClient client(L"http://www.google.com/");
 
client.SendHttpRequest();
wstring httpResponseHeader = client.GetResponseHeader();
wstring httpResponseContent = client.GetResponseContent();

// Update the URL.
client.UpdateUrl(L"http://www.microsoft.com/");
client.SendHttpRequest();
httpResponseHeader = client.GetResponseHeader();
httpResponseContent = client.GetResponseContent();

A Complete Example

Codeproject.com needs logging in to download the files. This example logs in, gets the cookies, requests the source code (win_HTTP_wrapper/WinHttpClient_Src.zip) of my first CodeProject article, A Simple Windows HTTP Wrapper Using C++, and then saves the file to hard disk. This example includes cookies handling, post requests, request headers customization, etc.

C++
// 1. Get the initial cookie.
WinHttpClient getClient
	(L"http://www.codeproject.com/script/Membership/LogOn.aspx");
getClient.SetAdditionalRequestHeaders
	(L"Accept: image/gif, image/jpeg, image/pjpeg, image/pjpeg, ...");
if (!getClient.SendHttpRequest())
{
    return;
}
 
// 2. Post data to get the authentication cookie.
WinHttpClient postClient
	(L"http://www.codeproject.com/script/Membership/LogOn.aspx?rp=
	%2fscript%2fMembership%2fLogOn.aspx");
 
// Post data.
wstring username = L"YourCodeProjectUsername";
wstring password = L"YourPassword";
postClient.SetAdditionalRequestCookies(getClient.GetResponseCookies());
string data = "FormName=MenuBarForm&Email=";
data += (char *)_bstr_t(username.c_str());
data += "&Password=";
data += (char *)_bstr_t(password.c_str());
data += "&RememberMeCheck=1";
postClient.SetAdditionalDataToSend((BYTE *)data.c_str(), data.size());
 
// Post headers.
wstring headers = L"...Content-Length: %d\r\nProxy-Connection: 
		Keep-Alive\r\nPragma: no-cache\r\n";
wchar_t szHeaders[MAX_PATH * 10] = L"";
swprintf_s(szHeaders, MAX_PATH * 10, headers.c_str(), data.size());
postClient.SetAdditionalRequestHeaders(szHeaders);
if (!postClient.SendHttpRequest(L"POST", true))
{
    return;
}
 
// 3. Finally get the zip file.    
WinHttpClient downloadClient(L"win_HTTP_wrapper/WinHttpClient_Src.zip");
downloadClient.SetUserAgent(L"Mozilla/4.0 
		(compatible; MSIE 8.0; Windows NT 5.1; ...)");
 
// Sending this cookie makes the server believe you have already logged in.
downloadClient.SetAdditionalRequestCookies(postClient.GetResponseCookies());
if (!downloadClient.SendHttpRequest())
{
    return;
}
downloadClient.SaveResponseToFile(L"C:\\WinHttpClient_Src.zip");

Points of Interest

  • Sometimes, it is a good idea to get a piece of new code working first and improve it later.
  • Reading the Hypertext Transfer Protocol (RFC 2616) will help a lot.
  • Use HTTP monitoring tools to help the development, such as HTTPAnalyzer or HTTPWatch.
  • It is fast and easy to use class _bstr_t to convert between wchar_t* and char*.

History

  • 2010-9-21 2 enhancements, thanks Scott Leckie
  • 2010-4-29 2 Bugs fixed, thanks Wong Shao Voon
  • 2009-9 Fully featured version
  • 2008-7 Initial version

License

This article, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)


Written By
Software Developer Philips
China China
Cheng Shi is a software developer in China. He is interested in COM, ATL, Direct3D, etc. He is now working for Philips.

Cheng Shi loves Formula1 and watchs every Grand Prix. He is dreaming to be a racing car driver. Hope his dream can come true.

Comments and Discussions

 
GeneralMy vote of 5 Pin
mikhail27-Jun-10 23:40
mikhail27-Jun-10 23:40 
QuestiondisableAutoRedirect doesnot work? Pin
zhanghijun5-Jun-10 4:23
zhanghijun5-Jun-10 4:23 
AnswerRe: disableAutoRedirect doesnot work? Pin
shicheng6-Jun-10 4:44
shicheng6-Jun-10 4:44 
GeneralRe: disableAutoRedirect doesnot work? Pin
zhanghijun6-Jun-10 10:12
zhanghijun6-Jun-10 10:12 
Questionwhat about MIME data or Form Data? Pin
wheregone2-Jun-10 4:29
wheregone2-Jun-10 4:29 
AnswerRe: what about MIME data or Form Data? Pin
shicheng2-Jun-10 5:09
shicheng2-Jun-10 5:09 
GeneralExcellent! Pin
scott.leckie26-May-10 4:27
scott.leckie26-May-10 4:27 
GeneralMemory leak and some minor suggestions Pin
Shao Voon Wong28-Apr-10 18:47
mvaShao Voon Wong28-Apr-10 18:47 
GeneralRe: Memory leak and some minor suggestions Pin
shicheng28-Apr-10 20:32
shicheng28-Apr-10 20:32 
GeneralUsing the code to download a specific string from a web page Pin
Michael B Pliam19-Apr-10 9:59
Michael B Pliam19-Apr-10 9:59 
GeneralRe: Using the code to download a specific string from a web page Pin
shicheng19-Apr-10 23:02
shicheng19-Apr-10 23:02 
GeneralRe: Using the code to download a specific string from a web page Pin
Michael B Pliam20-Apr-10 9:32
Michael B Pliam20-Apr-10 9:32 
GeneralRe: Using the code to download a specific string from a web page Pin
shicheng20-Apr-10 15:24
shicheng20-Apr-10 15:24 
GeneralRe: Using the code to download a specific string from a web page [modified] Pin
Michael B Pliam20-Apr-10 22:04
Michael B Pliam20-Apr-10 22:04 
GeneralRe: Using the code to download a specific string from a web page Pin
shicheng20-Apr-10 23:03
shicheng20-Apr-10 23:03 
GeneralRe: Using the code to download a specific string from a web page Pin
Michael B Pliam21-Apr-10 5:27
Michael B Pliam21-Apr-10 5:27 
GeneralRe: Using the code to download a specific string from a web page Pin
Michael B Pliam25-Apr-10 8:01
Michael B Pliam25-Apr-10 8:01 
GeneralRe: Using the code to download a specific string from a web page Pin
shicheng25-Apr-10 14:55
shicheng25-Apr-10 14:55 
QuestionCould I use this code to silently upload data from app to web server database? Pin
Michael B Pliam31-Mar-10 13:31
Michael B Pliam31-Mar-10 13:31 
AnswerRe: Could I use this code to silently upload data from app to web server database? Pin
shicheng31-Mar-10 16:09
shicheng31-Mar-10 16:09 
GeneralRe: Could I use this code to silently upload data from app to web server database? Pin
Michael B Pliam2-Apr-10 14:46
Michael B Pliam2-Apr-10 14:46 
GeneralRe: Could I use this code to silently upload data from app to web server database? Pin
shicheng3-Apr-10 3:30
shicheng3-Apr-10 3:30 
GeneralRe: Could I use this code to silently upload data from app to web server database? Pin
Michael B Pliam14-Apr-10 7:12
Michael B Pliam14-Apr-10 7:12 
GeneralRe: Could I use this code to silently upload data from app to web server database? [modified] Pin
shicheng15-Apr-10 2:31
shicheng15-Apr-10 2:31 
GeneralRe: Could I use this code to silently upload data from app to web server database? Pin
Michael B Pliam16-Apr-10 8:13
Michael B Pliam16-Apr-10 8:13 

General General    News News    Suggestion Suggestion    Question Question    Bug Bug    Answer Answer    Joke Joke    Praise Praise    Rant Rant    Admin Admin   

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.