Click here to Skip to main content
Click here to Skip to main content

A Fully Featured Windows HTTP Wrapper in C++

By , 22 Sep 2010
 

Introduction

This is a fully featured Windows HTTP Wrapper in C++. It is a wrapper in the C++ class. It is fully featured and easy to use. You only need to include one single header file to use the wrapper.

Background

Several months ago, I posted my first article A Simple Windows HTTP Wrapper Using C++ on CodeProject. I continued to update it in the last several months and finally got the fully featured Windows HTTP Wrapper based on WinHTTP APIs in C++.

Features

  • Cookies supported
  • Proxy supported
  • GET, POST methods supported
  • Request headers customization supported
  • Disable automatic redirection supported
  • HTTPS supported
  • Receive progress supported
  • Some other features

Using the Code

The class diagram is as follows:

class.JPG

You can understand most of the functions from their names. Please refer to the examples section for some typical examples.

Examples

Simple Get Request

Get request is the most common request. Browsing a web page causes one or several Get requests.

// Set URL.
WinHttpClient client(L"http://www.codeproject.com/");
 
// Send HTTP request, a GET request by default.
client.SendHttpRequest();
 
// The response header.
wstring httpResponseHeader = client.GetResponseHeader();
 
// The response content.
wstring httpResponseContent = client.GetResponseContent();

Simple Post Request

Post request usually occurs while logging in or posting a thread.

WinHttpClient client(L"http://www.codeproject.com/");
 
// Set post data.
string data = "title=A_NEW_THREAD&content=This_is_a_new_thread.";
client.SetAdditionalDataToSend((BYTE *)data.c_str(), data.size());
 
// Set request headers.
wchar_t szSize[50] = L"";
swprintf_s(szSize, L"%d", data.size());
wstring headers = L"Content-Length: ";
headers += szSize;
headers += L"\r\nContent-Type: application/x-www-form-urlencoded\r\n";
client.SetAdditionalRequestHeaders(headers);
 
// Send HTTP post request.
client.SendHttpRequest(L"POST");
 
wstring httpResponseHeader = client.GetResponseHeader();
wstring httpResponseContent = client.GetResponseContent();

Getting Request's Progress

You can specify a callback function to get the request's progress.

// Progress - finished percentage.
bool ProgressProc(double progress)
{
    wprintf(L"Current progress: %-.1f%%\r\n", progress);
    return true;
}
 
void ProgressTest(void)
{
    // Set URL and call back function.
    WinHttpClient client(L"http://www.codeproject.com/", ProgressProc);
    client.SendHttpRequest();
    wstring httpResponseHeader = client.GetResponseHeader();
    wstring httpResponseContent = client.GetResponseContent();
}

Specifying the User Agent

User agent is a string used by the clients to identify themselves to the web server so that the server can tell which client software you use, Internet Explorer 8, Chrome or FireFox. You can specify the user agent to pretend to be Internet Explorer 8 to fool the web server because sometimes the server only supports Internet Explorer 8.

WinHttpClient client(L"http://www.codeproject.com/");
 
// Set the user agent to the same as Internet Explorer 8.
client.SetUserAgent(L"Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1;...)");
 
client.SendHttpRequest();
wstring httpResponseHeader = client.GetResponseHeader();
wstring httpResponseContent = client.GetResponseContent();

Specifying the Proxy

Sometimes, we have to connect to the web through proxies. WinHttpClient connects to the web server directly and then uses the Internet Explorer setting to connect if it fails by default. You can also specify the proxy by calling function SetProxy.

WinHttpClient client(L"http://www.codeproject.com/");
 
// Set the proxy to 192.168.0.1 with port 8080.
client.SetProxy(L"192.168.0.1:8080");
 
client.SendHttpRequest();
wstring httpResponseHeader = client.GetResponseHeader();
wstring httpResponseContent = client.GetResponseContent();

Handling Cookies

A cookie (also tracking cookie, browser cookie, and HTTP cookie) is a small piece of text stored on a user's computer by a web browser. A cookie consists of one or more name-value pairs containing bits of information.

The cookie is sent as an HTTP header by a web server to a web browser and then sent back unchanged by the browser each time it accesses that server. A cookie can be used for authentication, session tracking (state maintenance), storing site preferences, shopping cart contents, the identifier for a server-based session, or anything else that can be accomplished through storing textual data (http://en.wikipedia.org/wiki/HTTP_cookie).

You can specify cookies to send by calling SetAdditionalRequestCookies and get the response cookies by calling GetResponseCookies.

WinHttpClient client(L"http://www.codeproject.com/");
 
// Set the cookies to send.
client.SetAdditionalRequestCookies(L"username=jack");
 
client.SendHttpRequest();
 
// Get the response cookies.
wstring httpResponseCookies = client.GetResponseCookies();
 
wstring httpResponseHeader = client.GetResponseHeader();
wstring httpResponseContent = client.GetResponseContent();

HTTPS

WinHttpClient client(L"https://www.google.com/");

// Accept any certificate while performing HTTPS request.
client.RequireValidSslCertificates(false);

client.SendHttpRequest();
wstring httpResponseHeader = client.GetResponseHeader();
wstring httpResponseContent = client.GetResponseContent();

Multiple Requests

WinHttpClient client(L"http://www.google.com/");
 
client.SendHttpRequest();
wstring httpResponseHeader = client.GetResponseHeader();
wstring httpResponseContent = client.GetResponseContent();

// Update the URL.
client.UpdateUrl(L"http://www.microsoft.com/");
client.SendHttpRequest();
httpResponseHeader = client.GetResponseHeader();
httpResponseContent = client.GetResponseContent();

A Complete Example

Codeproject.com needs logging in to download the files. This example logs in, gets the cookies, requests the source code (win_HTTP_wrapper/WinHttpClient_Src.zip) of my first CodeProject article, A Simple Windows HTTP Wrapper Using C++, and then saves the file to hard disk. This example includes cookies handling, post requests, request headers customization, etc.

// 1. Get the initial cookie.
WinHttpClient getClient
	(L"http://www.codeproject.com/script/Membership/LogOn.aspx");
getClient.SetAdditionalRequestHeaders
	(L"Accept: image/gif, image/jpeg, image/pjpeg, image/pjpeg, ...");
if (!getClient.SendHttpRequest())
{
    return;
}
 
// 2. Post data to get the authentication cookie.
WinHttpClient postClient
	(L"http://www.codeproject.com/script/Membership/LogOn.aspx?rp=
	%2fscript%2fMembership%2fLogOn.aspx");
 
// Post data.
wstring username = L"YourCodeProjectUsername";
wstring password = L"YourPassword";
postClient.SetAdditionalRequestCookies(getClient.GetResponseCookies());
string data = "FormName=MenuBarForm&Email=";
data += (char *)_bstr_t(username.c_str());
data += "&Password=";
data += (char *)_bstr_t(password.c_str());
data += "&RememberMeCheck=1";
postClient.SetAdditionalDataToSend((BYTE *)data.c_str(), data.size());
 
// Post headers.
wstring headers = L"...Content-Length: %d\r\nProxy-Connection: 
		Keep-Alive\r\nPragma: no-cache\r\n";
wchar_t szHeaders[MAX_PATH * 10] = L"";
swprintf_s(szHeaders, MAX_PATH * 10, headers.c_str(), data.size());
postClient.SetAdditionalRequestHeaders(szHeaders);
if (!postClient.SendHttpRequest(L"POST", true))
{
    return;
}
 
// 3. Finally get the zip file.    
WinHttpClient downloadClient(L"win_HTTP_wrapper/WinHttpClient_Src.zip");
downloadClient.SetUserAgent(L"Mozilla/4.0 
		(compatible; MSIE 8.0; Windows NT 5.1; ...)");
 
// Sending this cookie makes the server believe you have already logged in.
downloadClient.SetAdditionalRequestCookies(postClient.GetResponseCookies());
if (!downloadClient.SendHttpRequest())
{
    return;
}
downloadClient.SaveResponseToFile(L"C:\\WinHttpClient_Src.zip");

Points of Interest

  • Sometimes, it is a good idea to get a piece of new code working first and improve it later.
  • Reading the Hypertext Transfer Protocol (RFC 2616) will help a lot.
  • Use HTTP monitoring tools to help the development, such as HTTPAnalyzer or HTTPWatch.
  • It is fast and easy to use class _bstr_t to convert between wchar_t* and char*.

History

  • 2010-9-21 2 enhancements, thanks Scott Leckie
  • 2010-4-29 2 Bugs fixed, thanks Wong Shao Voon
  • 2009-9 Fully featured version
  • 2008-7 Initial version

License

This article, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

About the Author

shicheng
Software Developer Philips
China China
Member
Cheng Shi is a software developer in China. He is interested in COM, ATL, Direct3D, etc. He is now working for Philips.
 
Cheng Shi loves Formula1 and watchs every Grand Prix. He is dreaming to be a racing car driver. Hope his dream can come true.

Sign Up to vote   Poor Excellent
Add a reason or comment to your vote: x
Votes of 3 or less require a comment

Comments and Discussions

 
You must Sign In to use this message board.
Search this forum  
    Spacing  Noise  Layout  Per page   
GeneralMy vote of 5membermadkoala19 May '13 - 0:42 
Excellent!! You saved me a lot of time. Thank you for sharing.
Questionhow is it possibility to use this Wrapper in Win CE ?memberO_D_I_M16 May '13 - 2:35 
Hello together,
 
I`m looking a long time for a C++ Wrapper like this - this is a great Solution.
But now my Request: i have to use it in Unicode compiled Application to use ist on Win CE 6.0
 
My Problem: when i open a new Testproject for "intelligent devices" and include the WinHttpClient ("#include "WinHttpClient.h" e.g. in Main.cpp or Main.h) it does not compile.
 
pleas let me Know how i can use this great Wrapper in MFC Application for Win CE
 
compile looks like this:
 
1>Test_http.cpp
1>d:\Program Files\Microsoft Visual Studio 9.0\VC\ce\include\xiosbase(209) : error C2470: "ios_base": Sieht wie eine Funktionsdefinition aus, es ist aber keine Parameterliste vorhanden; sichtbarer Funktionstext wird übersprungen.
1>d:\Program Files\Microsoft Visual Studio 9.0\VC\ce\include\streambuf(54) : error C2653: 'ios_base': Keine Klasse oder Namespace
1>        d:\Program Files\Microsoft Visual Studio 9.0\VC\ce\include\streambuf(441): Siehe Verweis auf die Instanziierung der gerade kompilierten Klassen-template "std::basic_streambuf<_Elem,_Traits>".
1>d:\Program Files\Microsoft Visual Studio 9.0\VC\ce\include\streambuf(54) : error C2061: Syntaxfehler: Bezeichner 'seekdir'
1>d:\Program Files\Microsoft Visual Studio 9.0\VC\ce\include\streambuf(60) : error C2653: 'ios_base': Keine Klasse oder Namespace
1>d:\Program Files\Microsoft Visual Studio 9.0\VC\ce\include\streambuf(60) : error C2061: Syntaxfehler: Bezeichner 'seek_dir'
1>d:\Program Files\Microsoft Visual Studio 9.0\VC\ce\include\streambuf(62) : error C2535: '_Traits::pos_type std::basic_streambuf<_Elem,_Traits>::pubseekoff(_Traits::off_type)': Memberfunktion bereits definiert oder deklariert
1>        d:\Program Files\Microsoft Visual Studio 9.0\VC\ce\include\streambuf(54): Siehe Deklaration von 'std::basic_streambuf<_Elem,_Traits>::pubseekoff'
1>d:\Program Files\Microsoft Visual Studio 9.0\VC\ce\include\streambuf(68) : error C2653: 'ios_base': Keine Klasse oder Namespace
1>d:\Program Files\Microsoft Visual Studio 9.0\VC\ce\include\streambuf(68) : error C2061: Syntaxfehler: Bezeichner 'openmode'
1>d:\Program Files\Microsoft Visual Studio 9.0\VC\ce\include\streambuf(73) : error C2653: 'ios_base': Keine Klasse oder Namespace
1>d:\Program Files\Microsoft Visual Studio 9.0\VC\ce\include\streambuf(73) : error C2061: Syntaxfehler: Bezeichner 'open_mode'
1>d:\Program Files\Microsoft Visual Studio 9.0\VC\ce\include\streambuf(74) : error C2535: '_Traits::pos_type std::basic_streambuf<_Elem,_Traits>::pubseekpos(_Traits::pos_type)': Memberfunktion bereits definiert oder deklariert

AnswerRe: how is it possibility to use this Wrapper in Win CE ?membershicheng16 May '13 - 16:12 
Hi,
 
I don't try this library in Win CE. The APIs of the Win CE is a sub set of Win 32. So I think you can try to get rid of the unnecessary header files of this library carefully.
 
Good luck!
 
Thanks,
Cheng Shi
GeneralMy vote of 5memberMember 1004277410 May '13 - 5:24 
This wrapper quite literally saved my life today.
GeneralMy vote of 2memberKarstenK17 Apr '13 - 1:54 
Somehow short on Auth and https for a "full featured class"
 
Because it is a big area much is missing....
GeneralMy vote of 5memberMarcos Roberto Silva21 Mar '13 - 10:49 
Great library
Question'RequireValidSslCertificates' is not a member of 'WinHttpClient'memberkuhliefumdenteich30 Jan '13 - 2:01 
Hi,
 
the code
client.RequireValidSslCertificates(false);
gives me error while compiling:
 
error C2039: 'RequireValidSslCertificates' is not a member of 'WinHttpClient'
 
How can I fix this?
 
thanks in advance
GeneralMy vote of 5memberlittlewater27 Jan '13 - 20:29 
plan to replace MFC version of winhttp, it is!
QuestionGreat librarymemberYiannis Spyridakis13 Dec '12 - 0:02 
Hi,
Great lib - thanks.
 
CodeProject's login page has been 'Moved Permanently' (HTTP:301) so the example doesn't work at the moment.
 
I noticed 'Location' isn't read correctly off the response header and this is because the regex for the field is incorrect(it looks for numeric values). This fixed it for me (not absolutely sure about the replacement regex but it seems to work...):
    //regExp = L"Location: {[0-9]+}";
    regExp = L"Location: {[a-zA-Z0-9\\-\\.\\:/]+}";
 
Thanks again, this library is exactly what I was looking for!
 
Yiannis
GeneralMy vote of 5memberFred Ackers20 Sep '12 - 11:55 
Just what I needed!

General General    News News    Suggestion Suggestion    Question Question    Bug Bug    Answer Answer    Joke Joke    Rant Rant    Admin Admin   

Permalink | Advertise | Privacy | Mobile
Web01 | 2.6.130523.1 | Last Updated 22 Sep 2010
Article Copyright 2010 by shicheng
Everything else Copyright © CodeProject, 1999-2013
Terms of Use
Layout: fixed | fluid