Click here to Skip to main content
15,170,505 members
Articles / Mobile Apps / Windows Mobile
Posted 16 May 2008


38 bookmarked

UTF16 to UTF8 to UTF16 simple CString based conversion

Rate me:
Please Sign up or sign in to vote.
3.96/5 (15 votes)
16 May 2008CPOL
Use CString to convert betwen UTF8 and UTF16.


For conversion of strings between UTF8 and UTF16 (as well as other formats), Microsoft gives us the MultiByteToWideChar and WideCharToMultiByte functions. These functions use null terminated char/widechar based strings. Use of those strings requires a bit of memory management, and if you use the functions extensively, your code may end up looking like a complete mess. That's why I decided to wrap these two functions for use with the more coder-friendly CString types.

The conversion functions


CStringA UTF16toUTF8(const CStringW& utf16)
   CStringA utf8;
   int len = WideCharToMultiByte(CP_UTF8, 0, utf16, -1, NULL, 0, 0, 0);
   if (len>1)
      char *ptr = utf8.GetBuffer(len-1);
      if (ptr) WideCharToMultiByte(CP_UTF8, 0, utf16, -1, ptr, len, 0, 0);
   return utf8;


CStringW UTF8toUTF16(const CStringA& utf8)
   CStringW utf16;
   int len = MultiByteToWideChar(CP_UTF8, 0, utf8, -1, NULL, 0);
   if (len>1)
      wchar_t *ptr = utf16.GetBuffer(len-1);
      if (ptr) MultiByteToWideChar(CP_UTF8, 0, utf8, -1, ptr, len);
   return utf16;

Using the code

Use of the two helper functions is straightforward. But, do note that they are only useful if your project is set to use the UNICODE character set. The functions also only work in Visual Studio 7.1 or above. If you use Visual Studio 6.0, you won't be able to compile because you miss CStringA and CStringW. In the following code snippet, you have a usage example:

CStringW utf16("òèçùà12345");
CStringA utf8 = UTF16toUTF8(utf16);
CStringW utf16_2 = UTF8toUTF16(utf8);


After a comment by Ivo Beltchev, I decided to change the functions as he suggested. Initially, I designed the functions like this:

CStringA UTF16toUTF8(const CStringW& utf16)
  LPSTR pszUtf8 = NULL;
  CStringA utf8("");

  if (utf16.IsEmpty()) 
    return utf8; //empty imput string

  size_t nLen16 = utf16.GetLength();
  size_t nLen8 = 0;

  if ((nLen8 = WideCharToMultiByte (CP_UTF8, 0, utf16, nLen16, 
                                    NULL, 0, 0, 0) + 2) == 2)
    return utf8; //conversion error!

  pszUtf8 = new char [nLen8];
  if (pszUtf8)
    memset (pszUtf8, 0x00, nLen8);
    WideCharToMultiByte(CP_UTF8, 0, utf16, nLen16, pszUtf8, nLen8, 0, 0);
    utf8 = CStringA(pszUtf8);

  delete [] pszUtf8;
  return utf8; //utf8 encoded string

CStringW UTF8toUTF16(const CStringA& utf8)
  LPWSTR pszUtf16 = NULL;
  CStringW utf16("");
  if (utf8.IsEmpty()) 
    return utf16; //empty imput string

  size_t nLen8 = utf8.GetLength();
  size_t nLen16 = 0;

  if ((nLen16 = MultiByteToWideChar (CP_UTF8, 0, utf8, nLen8, NULL, 0)) == 0)
    return utf16; //conversion error!

  pszUtf16 = new wchar_t[nLen16];
  if (pszUtf16)
    wmemset (pszUtf16, 0x00, nLen16);
    MultiByteToWideChar (CP_UTF8, 0, utf8, nLen8, pszUtf16, nLen16);
    utf16 = CStringW(pszUtf16);

  delete [] utf16;
  return utf16; //utf16 encoded string

These functions work just as well, but the latter versions are smaller and a bit optimized. Thanks to Ivo for the observation!


This article, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)


About the Author

John Paul Pirau
Software Developer (Senior)
Romania Romania
No Biography provided

Comments and Discussions

QuestionThere no need to adjust len for GetBuffer! Pin
Theo Buys15-Mar-17 4:02
MemberTheo Buys15-Mar-17 4:02 
BugSmall bug ... Pin
Tomice14-Jan-15 23:26
MemberTomice14-Jan-15 23:26 
QuestionConsider using CA2T and CT2A Pin
kanalbrummer24-Nov-13 4:11
Memberkanalbrummer24-Nov-13 4:11 
AnswerRe: Consider using CA2T and CT2A Pin
Theo Buys13-Apr-15 6:15
MemberTheo Buys13-Apr-15 6:15 
QuestionTraditional Chinese characters aren’t being read from network stream Pin
Balaji198222-Mar-12 18:53
professionalBalaji198222-Mar-12 18:53 
GeneralMy vote of 3 Pin
Dezhi Zhao13-Jan-11 5:55
MemberDezhi Zhao13-Jan-11 5:55 
GeneralEven more elegant! Pin
Elmue23-Aug-08 11:37
MemberElmue23-Aug-08 11:37 
GeneralRe: Even more elegant! [modified] Pin
John Paul Pirau4-Sep-08 3:25
MemberJohn Paul Pirau4-Sep-08 3:25 
GeneralYes it is more elegant and it works! Pin
Elmue9-Sep-08 17:05
MemberElmue9-Sep-08 17:05 
GeneralEven more elegant? Pin
Theo Buys15-Mar-17 6:40
MemberTheo Buys15-Mar-17 6:40 
GeneralRe: Even more elegant? Pin
Elmue15-Mar-17 10:31
MemberElmue15-Mar-17 10:31 
GeneralRe: Even more elegant? Pin
Theo Buys16-Mar-17 8:25
MemberTheo Buys16-Mar-17 8:25 
GeneralRe: Even more elegant? Pin
Elmue17-Mar-17 10:42
MemberElmue17-Mar-17 10:42 
GeneralRe: Even more elegant? Pin
Theo Buys18-Mar-17 14:02
MemberTheo Buys18-Mar-17 14:02 
QuestionSince when CStringA is UTF-8? Pin
Shao Voon Wong19-May-08 23:13
mvaShao Voon Wong19-May-08 23:13 
AnswerRe: Since when CStringA is UTF-8? Pin
John Paul Pirau20-May-08 0:03
MemberJohn Paul Pirau20-May-08 0:03 
AnswerRe: Since when CStringA is UTF-8? Pin
Nemanja Trifunovic29-May-08 5:02
MemberNemanja Trifunovic29-May-08 5:02 
GeneralRe: Since when CStringA is UTF-8? Pin
John Paul Pirau3-Jun-08 0:26
MemberJohn Paul Pirau3-Jun-08 0:26 
GeneralRe: Since when CStringA is UTF-8? Pin
Theo Buys13-Apr-15 6:35
MemberTheo Buys13-Apr-15 6:35 
GeneralNo need for a temporary buffer Pin
Ivo Beltchev17-May-08 9:48
MemberIvo Beltchev17-May-08 9:48 
GeneralRe: No need for a temporary buffer Pin
John Paul Pirau19-May-08 3:35
MemberJohn Paul Pirau19-May-08 3:35 
QuestionRe: No need for a temporary buffer Pin
guoxuran21-Jun-09 18:54
Memberguoxuran21-Jun-09 18:54 

General General    News News    Suggestion Suggestion    Question Question    Bug Bug    Answer Answer    Joke Joke    Praise Praise    Rant Rant    Admin Admin   

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.