Unicode Data transfer Using in CSV by C++

Question

1.00/5 (1 vote)

See more:

I am reading a unicode data from a data base say MS Sql and trying to write in .CSV files. I am not able to write it properly it is replacing with '???'.

do any one has any idea?

Same problem i was facing when i was storing a unicode data in MYSQL data base.but i fixed this issue by converting wsrting to utf8.

Posted 9-Dec-11 3:41am

AMIT KUAMR SINGH

Add a Solution

Comments

JackDingler 9-Dec-11 10:10am

Are you writing the BOM?

UTF-8, UTF-16, UTF-32 & BOM

1 solution

Add a Solution

Add your solution here

Treat my content as plain text, not as HTML

Preview 0

…

Existing Members

Sign in to your account

...or Join us

Download, Vote, Comment, Publish.

Your Email
Password
Forgot your password?

Your Email
This email is in use. Do you need your password?
Optional Password

I have read and agree to the Terms of Service and Privacy Policy
Please subscribe me to the CodeProject newsletters

When answering a question please:

Read the question carefully.
Understand that English isn't everyone's first language so be lenient of bad spelling and grammar.
If a question is poorly phrased then either ask for clarification, ignore it, or edit the question and fix the problem. Insults are not welcome.
Don't tell someone to read the manual. Chances are they have and don't get it. Provide an answer or move on to the next question.

Let's work to help developers, not make them feel stupid.

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

Jochen Arndt · Answer 1 · 2011-12-09T23:48:00

As you know from storing, it is a conversion problem. Database file usually use UTF-8 while Windows uses UTF-16LE (wchar). CSV files are mainly not Unicode but plain text. You should check if the program that should be used to read the CSV file supports Unicode encoded CSV files and which kind of encoding. If not, you may convert to an ANSI codepage.

In general:
Read from DB: Convert UTF-8 to wchar for processing
Write to DB: Convert wchar to UTF-8
Write CSV: Convert wchar to the encoding supported by the receiving program

When writing UTF files, you should place the BOM marker at the begin of file.

Jochen Arndt