unicode chr in arabic lang

Question

0.00/5 (No votes)

See more:

i want to find hex number of each char of string

i use two method (substring and arry )

here it is the problem
string = "ههه"
in sub string = "ه" + "ه" + "ه" ?????
and have same hex number what can i do to find char hex number

Posted 20-Jun-12 5:13am

red_ostad

Updated 20-Jun-12 5:14am

Mehdi Gholam

v2

Add a Solution

Comments

Sergey Alexandrovich Kryukov 20-Jun-12 11:17am

I can easily find it out, if you confirm: did you look at this page properly after you done this post? Does your text look correct? This page is in UTF-8...
--SA

red_ostad 20-Jun-12 11:55am

yes its correct

Sergey Alexandrovich Kryukov 20-Jun-12 11:42am

Anyway, I answered... please make sure you can use my instructions to find such things by yourself next time...
--SA

red_ostad 20-Jun-12 11:56am

link plz

1 solution

Add a Solution

Add your solution here

Treat my content as plain text, not as HTML

Preview 0

…

Existing Members

Sign in to your account

...or Join us

Download, Vote, Comment, Publish.

Your Email
Password
Forgot your password?

Your Email
This email is in use. Do you need your password?
Optional Password

I have read and agree to the Terms of Service and Privacy Policy
Please subscribe me to the CodeProject newsletters

When answering a question please:

Read the question carefully.
Understand that English isn't everyone's first language so be lenient of bad spelling and grammar.
If a question is poorly phrased then either ask for clarification, ignore it, or edit the question and fix the problem. Insults are not welcome.
Don't tell someone to read the manual. Chances are they have and don't get it. Provide an answer or move on to the next question.

Let's work to help developers, not make them feel stupid.

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

Sergey Alexandrovich Kryukov · Answer 1 · 2012-06-20T05:40:00

Solution 1

This is U+0647, 'ه', Arabic Letter "Heh".

This is the trick of Arabic writing system fully implemented in Windows and, to best of my knowledge, in nearly all modern OS: if you put some Arabic letters together, they change their glyph to form proper connections with each other. Look: "ههه". This is the same Arabic "Heh" repeated three times, even though this string looks like three different letters.

Now, you may ask: how to find it out? After all, you are not going ask me about every single character, are you?

To do this, you should understand how Unicode and UTFs work. Unicode is nothing like 16-bit encoding like may mistakenly think, rather, this is a standard defining one-to-one correspondence between "characters", understood as cultural entities abstracted from their glyph forms, and integer numbers, understood as abstract mathematical integer numbers, without any concern about their bit size or computer presentation. Those numbers are called "code points". So, the core Unicode does not define encoding. Encodings can be different and are defined by UTFs. Now, this page is in UTF-8, which is a byte code with variable size per character. So, if I simply tried to read your UTF-8 text in binary form, it would be hard to recognize the code points in this code. The only straightforward encoding with one-to-one correspondence between the encoding words and code points is UTF-64 (UTF-64LE or UTF-64RE). However, I knew for sure, that all Arabic subset lies in the BMP (Based Multilingual Plane) with code points within first 17 bits. Few more 16-bit places exists, but Arabic language is way too popular for that; the extra plains are reserved form much more exotic writing systems.

So, I copies your text in the text file and saved it as UTF-16LE (in Window jargon, it is called "Unicode files", but in fact this is UTF-16LE), opened it in the binary editors and recognized 4 identical Arabic code points U+0647. To find out what is it, I used the Windows application Character Map (Charmap.EXE) bundled with every version of Windows. It provided me with the information on the subset ("Unicode sub-range") of Arabic writing system (using code points U+06XX) and the information on this character.

Learn about it:

http://en.wikipedia.org/wiki/Unicode[^],
http://unicode.org/[^];

http://en.wikipedia.org/wiki/Code_point[^],
http://en.wikipedia.org/wiki/Basic_Multilingual_Plane#Basic_Multilingual_Plane[^],
http://en.wikipedia.org/wiki/UTF[^],
http://unicode.org/faq/utf_bom.html[^].

—SA

Posted 20-Jun-12 5:40am

Sergey Alexandrovich Kryukov

Updated 20-Jun-12 5:45am

v4

Comments

red_ostad 20-Jun-12 11:50am

thank but i want to quick help for find unicode number of each one .
i want to make script to revers arabic char to use in none right to left support
program . coud i find any code fo changed glyph chr . i mean if it changed it have new unicode char in character map . i use it before i ask this question .

Sergey Alexandrovich Kryukov 20-Jun-12 12:34pm

What do you mean "but"? I gave you not the exact recipe, I explained how it works. If you have any questions, don't hesitate to ask.
There is not such thing as "glyph character"!
When the glyph is changed, the code point is not changed. You don't actually have "new Unicode char", can you finally get it or not? In other words, the glyph in text depends on both code point and the location of the character in the text. I clearly demonstrated it to you! You can invoke Browser search to see that all 4 characters are the same. After all, read it all more thoroughly. It's really not so simple, needs some effort to understand.

If you can explain what would be the exact effect you want to achieve, I will be able to help you more; but don't forget to explain why.

--SA

VJ Reddy 20-Jun-12 13:16pm

Good answer with references. 5!

Sergey Alexandrovich Kryukov 20-Jun-12 13:31pm

Thank you, VJ.
Do you have any idea how to finally explain those not-so-trivial things to OP?
--SA

red_ostad 20-Jun-12 20:29pm

hello again and tnx for your Patience .
i dont hesitate to ask . i explain to you what exactly i want to do
i write code that revers the string of textbox to another text box in form
for example you type "abcdefg" and it convert to "gfedcba" .
but i found the problem here , in arabic char when i want to revers
the answer is wrong . for example input is "سلام" output is "مالس"
but i want to see "ﻡﺎﻟﺳ" (i type it whit character map)
you say (You don't actually have "new Unicode char")
but i see defrent hexa cod and unicode here . i know that i dont know
and its my tray . dont be angry with noob gay like me Even i dont attention
enough . and my eng lang is not pro :D .
and finally i tray to use Persian subtitle un none right to left support video editors . because if u use revers typing its work !
i use this code until now . best regard

namespace unicodex
{
public partial class Form1 : Form
{
public Form1()
{
InitializeComponent();
}

private void textBox1_TextChanged(object sender, EventArgs e)
{
textBox2.Text = Reverse(textBox1.Text);
label1.Text = hexacod(textBox1.Text);
}
public string Reverse(string str)
{
int len = str.Length;
string arrr="";
char[] arr = new char[len];

for (int i = 0; i < len; i++)
{

arr[i] = (char)((int)(str[len - 1 - i]));
arrr = arrr + " , " + arr[i];

}

return new string(arr);

}
public string hexacod(string str)
{
int len = str.Length;
string arr = "";
for (int i = 0; i < len; i++)
{
arr = arr+" , "+((int)(str[len - 1 - i])).ToString ();
}
return arr;
}

private void textBox2_TextChanged(object sender, EventArgs e)
{
label2.Text = hexacod(textBox2.Text);
}

Sergey Alexandrovich Kryukov 21-Jun-12 12:18pm

No, I'm not angry and thank you for explanation, and sorry for lack of patience, but I still don't understand. First of all, I cannot understand Arabic, Persian or any other language using this writing system, I just know some elementary basics about those languages and the writing system. In particular, I cannot see what is the "real" reverse of "سلام" :"مالس" or "ﻡﺎﻟﺳ" and I don't understand why do you think it should be the second. Can you tell me that character by character? Let's see (oh, mixing left-to-right with right-to-left in one string is so difficult for editing!).

I can tell you what I see in hexadecimal view when I created separate 3 file with all three words:
1) (source word) 0633, 0644, 0627, 0645
2) (after your inversion) 0645, 0627, 0644, 0633
3) (type manually) FEE1, FE8E, FEDF, FEB3
You see, your inversion is formally correct, and I don't know how what you want to see is related to it, but this is not the inversion of the characters. Let's see with Character Map:
FEE1: "Arabic letter Meem Isolated form"
FE8E: "Arabic letter Noon Isolated form"
FEDF: "Arabic letter Lam Initial form"
FEB3: "Arabic letter Seen Initial form"
Is it what you try to type in Character Map?
How this is related to your initial characters, I simply don't know. You need to describe how did you get it, exactly.

Your inversion is formally correct. Not good code though; you should not use "" (use string.Empty) and not use int typecast, work only with characters. Could be:


static string Reverse(string value) {
    System.Text.StringBuilder sb = new System.Text.StringBuilder();
    for (int index = value.Length - 1; index >= 0; --index)
        sb.Append(value[index]);
    return sb.ToString();
}
//just this; never use repeated string concatenation (+) -- strings are immutable

But you will get the same results.

Now, I just checked: you don't have my editor, but Notepad has "save as Unicode Big Endian", which is UTF-64LE, so in hex viewer the characters will look recognizable like in "U+0633". Use it and you will find the ends.

After all, write the code which put character in TextBox one-by-one (with some delimiter) and in one word, compare what you get. Read it back and compare.
--SA

red_ostad 21-Jun-12 16:03pm

ok it is good to see in hex editor after unicode saving thanks
in Persian and Arabic when you use two none isolated char after another
this to connect and change to diferent unicode character
if i revers exactly this changed character in result that i want and put in
adobe photoshop none me suppurt for exanple . the result in left to right is
the same as corect one . i meane if i past "ﻡﺎﻟﺳ" result in such program
is سلام .and its my goal i find the the free tool , named Arabicwriter

its do likely what i want but i think coder use the rules of arabic langoage
and its a lots of line that must cod to know the isolated and no isolated character . i can cod this but i think when we can see the character in text box . why i couldn't find the unicode number . i know may be its just in view and character in string is the same . thanks Sergey Alexandrovich Kryukov .

Sergey Alexandrovich Kryukov 29-Jun-12 20:58pm

I understand the difficulty. I just immediately suggested simple tools which everyone has at their fingers, and the method of looking on a binary level, otherwise it's easy to get lost.
This is good that you have this ArabicWriter. Writing Arabic is not easy, and it's even more difficult if different Unicode sets are mixed, left-to-right with right-to-left. I know because I tried several years before when I implemented a regular Unicode editor (which I still use) and wanted to test it well. Two co-workers was so nice to help me, one knew Mandarin, another one knew Arabic...
--SA

red_ostad 21-Jun-12 19:26pm

you say you should not use "" why ? its simple and quicker

Sergey Alexandrovich Kryukov 29-Jun-12 20:49pm

(Sigh...) I answered a minute ago but... I guess typing again would be easier then the search...

You see, not hard-coding any immediate constants is important for maintenance. At the same time, "" is valid, and is -- yes -- simple and quick. Other immediate constants are also convenient at the starting stage of development. It should explain why sometime you need to do clean-up work. You can make constants explicit, put is special classes and files, some go in data files and resources.

It's simple to do with string constants: you can make sure no one is left by searching for '"' in the file. Making exclusion just for "" breaks this convenience. Using only string.Empty makes it much, much easier. No " -- no problems.

Did I explain it clearly?
--SA

red_ostad 30-Jun-12 4:35am

yes t u .

Sergey Alexandrovich Kryukov 30-Jun-12 13:05pm

?

red_ostad 30-Jun-12 15:46pm

yes & thank you

Sergey Alexandrovich Kryukov 1-Jul-12 2:01am

Great. Good luck, call again.
--SA