Uniocode MFC application not able read ANSI encoded text file

Question

0.00/5 (No votes)

See more:

Hi! My unicode MFC application not able to read ANSI encoded text file.
and also if i change the project settings Unicode to MBCS then it is able to read ANSI text file. but not able to unicode text file.

Please do the needful...

The below is code snippet

C++

FILE *fpRead;
	const int l_size = 1024;
	TCHAR file_buffer[l_size];
	if(	(fpRead = _tfopen(strFilePath, _T("rb")) )== NULL)
	{			
		AfxMessageBox(_T("File not open"));
		return;
	}
	fseek(fpRead, 2, SEEK_SET);
	memset(file_buffer,'\0',sizeof(file_buffer));
	long l_file_pos = ftell(fpRead);		
	CString ss=_T("");		
	while(!feof(fpRead))
	{
		size_t count = fread(file_buffer, l_size+1,2, fpRead);
		AfxMessageBox(file_buffer);	
	}

Thanks and Regards
Sam

Posted 27-Jan-13 19:14pm

Mr Sam

Updated 27-Jan-13 20:12pm

Mohibur Rashid

v2

Add a Solution

3 solutions

Add a Solution

Add your solution here

Treat my content as plain text, not as HTML

Preview 0

…

Existing Members

Sign in to your account

...or Join us

Download, Vote, Comment, Publish.

Your Email
Password
Forgot your password?

Your Email
This email is in use. Do you need your password?
Optional Password

I have read and agree to the Terms of Service and Privacy Policy
Please subscribe me to the CodeProject newsletters

When answering a question please:

Read the question carefully.
Understand that English isn't everyone's first language so be lenient of bad spelling and grammar.
If a question is poorly phrased then either ask for clarification, ignore it, or edit the question and fix the problem. Insults are not welcome.
Don't tell someone to read the manual. Chances are they have and don't get it. Provide an answer or move on to the next question.

Let's work to help developers, not make them feel stupid.

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

Richard MacCutchan · Answer 1 · 2013-01-27T23:19:00

Solution 2

Take a look at my tip Handling simple text files in C/C++[^], for converting a file's content into the form that you want.

Posted 27-Jan-13 23:19pm

Richard MacCutchan

Mohibur Rashid · Answer 2 · 2013-01-27T20:26:00

Solution 1

if your file is ANSI then read as ANSI

C++

FILE *fpRead;
	char *file_buffer;
	if(	(fpRead = _tfopen(strFilePath, _T("rb")) )== NULL)
	{			
		AfxMessageBox(_T("File not open"));
		return;
	}
        fseek (fpRead, 0, SEEK_END);   // non-portable
        unsigned long  size=ftell (fpRead);
        file_buffer=new char[size];
        fread(file_buffer, 1, size, file_buffer);
        CString wfile_buffer;
        wfile_buffer=UTF8toUTF16(file_buffer); //definition stated below, apparently this function is not safe
	AfxMessageBox(wfile_buffer);
        delete file_buffer;

CStringW UTF8toUTF16(const CStringA& utf8)
{
   CStringW utf16;
   int len = MultiByteToWideChar(CP_UTF8, 0, utf8, -1, NULL, 0);
   if (len>1)
   { 
      wchar_t *ptr = utf16.GetBuffer(len-1);
      if (ptr) MultiByteToWideChar(CP_UTF8, 0, utf8, -1, ptr, len);
      utf16.ReleaseBuffer();
   }
   return utf16;
}

Posted 27-Jan-13 20:26pm

Mohibur Rashid

Updated 27-Jan-13 22:37pm

v2

Comments

Mr Sam 28-Jan-13 4:31am

This function is not working, getting errors on vc6.0. There is not CStringW, CStringA is not there CString only. Please check...

CStringW CFunctions::UTF8toUTF16(const CStringA& utf8)
{
CStringW utf16;
int len = MultiByteToWideChar(CP_UTF8, 0, utf8, -1, NULL, 0);
if (len>1)
{
wchar_t *ptr = utf16.GetBuffer(len-1);
if (ptr) MultiByteToWideChar(CP_UTF8, 0, utf8, -1, ptr, len);
utf16.ReleaseBuffer();
}
return utf16;
}

Mohibur Rashid 28-Jan-13 4:41am

did you remove the CFunctions:: before? CStringW is UNICODE version of character string CStringA is the ANSII version.....

it must have to be there. Even most of the Win32 API has two version. as example:
GetWindowLong is defined in header file as

#ifdef UNICODE
#define GetWindowLong GetWindowLongW
#else
#define GetWindowLong GetWindowLongA
#endif // !UNICODE

you can directly use anyone of them....................

But in this case you must have to use specific version of string otherwise you must get invalid result.

Mr Sam 28-Jan-13 4:52am

I have converted the code like this
CString UTF8toUTF16(const CString& utf8)
{
CString utf16;
int len = MultiByteToWideChar(CP_UTF8, 0, utf8, -1, NULL, 0);
if (len>1)
{
wchar_t *ptr = utf16.GetBuffer(len-1);
if (ptr) MultiByteToWideChar(CP_UTF8, 0, utf8, -1, ptr, len);
utf16.ReleaseBuffer();
}
return utf16;
}
and getting errors...
error C2664: 'MultiByteToWideChar' : cannot convert parameter 3 from 'const class CString' to 'const char *'

Mohibur Rashid 28-Jan-13 5:06am

Why did you CStringA to CString and CStringW to CString?

Mr Sam 28-Jan-13 5:10am

Giving error like: error C2501: 'CStringW' : missing storage-class or type specifiers

Jochen Arndt · Answer 3 · 2013-01-27T23:21:00

See the tip Handling simple text files in C/C++[^] here at CodeProject.

For a Unicode application, perform these steps:

Determine the file size.
Allocate a buffer of that size plus 1 [EDIT]2 bytes[/EDIT] for the terminating NULL character.
Read the file content into the buffer.
Terminate the string by setting the last character of the buffer to NULL.
Determine the encoding of the file.
If the encoding is UTF-16LE, you can use the buffer as it is.
Otherwise, convert the buffer content to Unicode (UTF-16LE) using MultiByteToWideChar() (call first with destination buffer and size set to NULL to get the required Unicode string length, allocate the Unicode string buffer, and perform the conversion).
Delete allocated buffers when not needed anymore (e.g. the file buffer after content has been converted to Unicode).