How do I convert string into utf 16

Question

0.00/5 (No votes)

See more:

i dont know how to convert the code in unicode in asp.net c# please help me asap. is c# code is unicode

What I have tried:

nothing to be tried yet im not aware of unicode so ill be confuse how to do that google would not be giving the full detail

Posted 19-Jun-18 1:20am

Shahbaz435

Updated 29-Jan-20 23:13pm

Add a Solution

2 solutions

Add a Solution

Add your solution here

Treat my content as plain text, not as HTML

Preview 0

…

Existing Members

Sign in to your account

...or Join us

Download, Vote, Comment, Publish.

Your Email
Password
Forgot your password?

Your Email
This email is in use. Do you need your password?
Optional Password

I have read and agree to the Terms of Service and Privacy Policy
Please subscribe me to the CodeProject newsletters

When answering a question please:

Read the question carefully.
Understand that English isn't everyone's first language so be lenient of bad spelling and grammar.
If a question is poorly phrased then either ask for clarification, ignore it, or edit the question and fix the problem. Insults are not welcome.
Don't tell someone to read the manual. Chances are they have and don't get it. Provide an answer or move on to the next question.

Let's work to help developers, not make them feel stupid.

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

Jochen Arndt · Answer 1 · 2018-06-19T01:48:00

Solution 1

.Net uses the UTF-16 encoding. You have to convert only when having data or passing data using other encodings.

See also Character Encoding in .NET | Microsoft Docs[^].

With text files, the used encoding can be indicated by a Byte order mark - Wikipedia[^] (mandatory for UTF-16, optional - but recommended - for UTF-8) and by headers when the file is for a specific protocol like HTML or XML.

For web servers and applications there are also often configuration options for the default encoding (e.g. the <globalization> Element | Microsoft Docs[^]).

[EDIT]
The real question has been found.

Quote:
i want to display the string data in unicode format like im having my name is "Shahbaz" is in string format and the convert it to the unicode is
U+0053 U+0068 U+0061 U+0068 U+0062 U+0061 U+007A

You just have to create a string using that format by iterating over the characters of the input string:

C#

// Using a StringBuilder is more efficient than appending to a string
StringBuilder sb = new StringBuilder(input.Length * 7);
// Iterate over the characters of the input string
foreach (char c in input)
{
    // Append the character code
    sb.AppendFormat("U+{0:X4} ", c);
}
// Create final output string
string output = sb.ToString();

[/EDIT]

Posted 19-Jun-18 1:48am

Jochen Arndt

Updated 20-Jun-18 0:21am

v2

Comments

Eric Lynch 19-Jun-18 13:11pm

To (hopefully) add a bit to Jochen's response, a C# string is always stored as UTF-16 within memory. There two common cases where you need to worry about the encoding: 1) you are reading or writing a file or 2) you are dealing with some non-.NET entity (via interop). For those cases, check out the suggested links.

Another concern can be with a user interface. There, you need to make certain you select a font that contains glyphs for the characters you expect to display. Though, this is a presentation issue, not an encoding issue. Usually, the default MS fonts are fairly decent for letters in most languages...less so for symbols.

Shahbaz435 20-Jun-18 1:27am

but my question is how to convert the string into utf 16 can u provide me the code in c#

Jochen Arndt 20-Jun-18 2:45am

If you have a C# string, it is already UTF-16 encoded because that is the encoding used internally by .Net.

Shahbaz435 20-Jun-18 2:48am

but i need the string should be u0012 like this format

Jochen Arndt 20-Jun-18 3:15am

A computer stores information binary. How data are interpreted is defined by data formats.

With a C# string, characters are stored as 16 bit ushort values according to the UTF-16 standard and the common output format is printing the corresponding characters.

If you want a different output or input format, you have to use appropriate functions or methods.

The 'uXXXX' notation is nothing else than the letter 'u' followed by a 16-bit hex value representing a single character. Other notations are the corresponding numerical values 0x0012 (hex) and 18 (decimal).

If you need to assing a character like 'u0012' to a string, you have to use a method supported by the compiler like
string test = "\x12";

Shahbaz435 20-Jun-18 3:18am

can u plz provide me a code for string to unicode convert in asp.net c#

Jochen Arndt 20-Jun-18 3:48am

Which string?
Again: A .Net string is Unicode!

Or do you have some kind of "escaped" string (which is Unicode) but want to "unesacpe" it?

Then provide an example string so that we know which kind of "escaping" is used. But such should be already handled by ASP.Net

Shahbaz435 20-Jun-18 4:16am

12345 this is my string i want to convert this string into unicode

Jochen Arndt 20-Jun-18 4:30am

What is the data type of that "string"?
Is it a literal string "12345"?
Is it a (decimal) literal number like int?
Is it the content of a variable (of which type)?

Shahbaz435 20-Jun-18 4:31am

nvarchar is the datatype of that string

Jochen Arndt 20-Jun-18 4:41am

NVARCHAR is an SQL data type which is not known by .Net.

However, if you use some kind of database interface, it will perform the conversion to/from string.

Shahbaz435 20-Jun-18 4:43am

im getting the value from database in that string and i want to convert that value in unicode

Jochen Arndt 20-Jun-18 5:37am

If you get it from the database as a C# string, it is already Unicode (because it is a C# string type). The database interface is performing conversions when necessary and possible (which isn't necessary here because NVARCHAR is also Unicode; at least with the MS SQL server).

All these discussions could have been avoided if you just have shown the code snippet where you retrieve the data from the database and a proper problem description (if there is any problem).

Shahbaz435 20-Jun-18 5:42am

as per ur guidance the c# code in unicode but i want to display the string data in unicode format like im having my name is "Shahbaz" is in string format and the convert it to the unicode is
U+0053 U+0068 U+0061 U+0068 U+0062 U+0061 U+007A
the above format i want want plz help me sir

Jochen Arndt 20-Jun-18 6:11am

That is a problem of displaying data.
I will add it to my solution.

Shahbaz435 20-Jun-18 6:18am

i know but i want that code for converting the string to unicode and display the data in unicode format plz help me sir plz plz

Jochen Arndt 20-Jun-18 6:25am

I have updated my solution.

But such is not called "conversion". It is called string formatting.

A proper question would have been
"How do I format / create a string showing the Unicode code points of a given string"
together with your above example.

Eric Lynch 20-Jun-18 6:34am

Sorry Jochen, we posted about the same thing at the same time. Combining our code, we would have a perfect solution. My code initially under-sizes the builder (should be same.Length * 7) and yours will have an extra space at the end of the text :) Though, yours is simpler to understand.

Jochen Arndt 20-Jun-18 6:40am

No problem. The thread is quite long anyway ;)

I thought about handling the extra space but it is also present in the example string and I decided to left avoiding it as an exercise.

Eric Lynch 20-Jun-18 6:28am

Is this what you are looking for?

string same = "Shahbaz";

var builder = new StringBuilder(same.Length * 5);
foreach (char chr in same)
{
if (builder.Length > 0)
builder.Append(' ');

builder.AppendFormat("U+{0:X4}", (ushort)chr);
}
string text = builder.ToString();
Console.WriteLine(text);

To be clear, the following text will be displayed to the console:
U+0053 U+0068 U+0061 U+0068 U+0062 U+0061 U+007A

Shahbaz435 20-Jun-18 7:16am

thank u sir

Shahbaz435 20-Jun-18 7:17am

thank u sir

Eric Lynch 20-Jun-18 6:21am

Using your example, the following code would NEVER display the word "No". Things really are always in UTF-16 in C# strings.

ushort[] codepoints = new ushort[] { 0x53, 0x68, 0x61, 0x68, 0x62, 0x61, 0x7A };
string utf16 = "\u0053\u0068\u0061\u0068\u0062\u0061\u007A";
string same = "Shahbaz";

Console.WriteLine(utf16 == same ? "Yes" : "No");

for (int index = 0; index < utf16.Length; index++)
if (utf16[index] != same[index] || utf16[index] != codepoints[index])
Console.WriteLine("No");

So, again, if you have a string, you by definition have something in UTF-16.

With regard to the database, nvarchar stores a Unicode representation in whatever encoding it chooses, you don't get to pick. In the case of SQL Server, this is also UTF-16. See the following, if you are unsure:

https://docs.microsoft.com/en-us/sql/relational-databases/collations/collation-and-unicode-support?view=sql-server-2017

Now, with regard to converting from a C# string (always UTF-16) to a native database encoding (up to the database product), this is handled (automatically) by software that is not under your control. Usually, with C#, some technology sits on top of the provider, and calls it on your behalf. This might be ADO.NET, LINQ to SQL, Entity Framework, or Entity Framework Core.

Hopefully, this helps you understand why your question as stated is not meaningful. I understand this can be confusing, but both Jochen and myself are providing you with accurate information. In this case, there is simply no work for you to do...so we can't provide you with code to do it :)

sarath124 · Answer 2 · 2020-01-29T23:14:00

You can convert string to UTF16 or Unicode

public static string GetSingleUnicodeHex(string strTextMsg)
{
     byte[] s1 = UTF8Encoding.Unicode.GetBytes(strTextMsg);
     string strUnicode = "";
     string strTmp1 = "";
     string strTmp2 = "";
     
     for (int i = 0; i < s1.Length; i += 2)
     {
        strTmp1 = int.Parse(s1[i + 1].ToString()).ToString("X");
        if (strTmp1.Length == 1)
              strTmp1 = "0" + strTmp1;

        strTmp2 = int.Parse(s1[i].ToString()).ToString("X");
        if (strTmp2.Length == 1)
              strTmp2 = "0" + strTmp2;

        strUnicode += strTmp1 + strTmp2;
     }
     return strUnicode;
}