Click here to Skip to main content
Click here to Skip to main content
Go to top

Convert String to 64bit Integer

, 20 Mar 2009
Rate this:
Please Sign up or sign in to vote.
A C# library general purpose function converts string to unique 64bit integer like object.GetHashCode()

Introduction

.NET Framework provides the 'GetHashcode()' function returning a 32bit Integer. You can convert 'string' to 32bit Integer but it doesn't guarantee a unique number. Here is the function that converts string to a unique 64bit integer, avoids collision domain level string store, compare and trace.

Background

If you need to store a large amount of URLs in your database, you must define 'character' index for manipulation. If you can generate a matching 'one-string-to-one-numeric-value' that can use as a numeric 'Key' instead of a variant length of string.

Using the Code

  1. Convert a variable length of string to fixed length of hashcode, and it must have fast hashing speed, so use .NET provided System.Security.Cryptography.SHA256CryptoServiceProvider.
  2. Convert 32 byte hashcode to 8 byte integer, avoiding making a collision.
/// <summary>
/// Return unique Int64 value for input string
/// </summary>
/// <param name="strText"></param>
/// <returns></returns>
static Int64 GetInt64HashCode(string strText)
{
    Int64 hashCode = 0;
    if (!string.IsNullOrEmpty(strText))
    {
        //Unicode Encode Covering all characterset
          byte[] byteContents = Encoding.Unicode.GetBytes(strText);
        System.Security.Cryptography.SHA256 hash = 
		new System.Security.Cryptography.SHA256CryptoServiceProvider();
        byte[] hashText = hash.ComputeHash(byteContents);
        //32Byte hashText separate
        //hashCodeStart = 0~7  8Byte
        //hashCodeMedium = 8~23  8Byte
        //hashCodeEnd = 24~31  8Byte
        //and Fold
        Int64 hashCodeStart = BitConverter.ToInt64(hashText, 0);
        Int64 hashCodeMedium = BitConverter.ToInt64(hashText, 8);
        Int64 hashCodeEnd = BitConverter.ToInt64(hashText, 24);
        hashCode = hashCodeStart ^ hashCodeMedium ^ hashCodeEnd;
    }
    return (hashCode);
}        

Collision and Performance Test

Tested platform: Core2Duo, Windows 2003 Server SP2, .NET Framework 3.5 SP1

10,000,000 Times generate GetInt64HashCode

Collision: Not found

100,000 Times generate ElapsedTime: 830 milliseconds

10,000,000 Times generate .NET Framework provided object.GetHashCode

Collision: 4,150 found

100,000 Times generate ElapsedTime: 35 milliseconds

Points of Interest

I know that Cryptography.SHA256 does not provide perfect collision avoided hash value and compressed 32Byte to 8Byte can increase collision probability, but I think the above function shows enough performance and avoids collision.

Your reply will make the function more efficient and reliable.

This function now uses and collects large amount of URLs. There is no collision for 40,000,000 unique URLs.

History

  • 20th March, 2009: Initial post

License

This article, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

Share

About the Author

Composition4
Software Developer Seoul , Korea
Korea (Republic Of) Korea (Republic Of)
develop, management software, website last six years, on .netframework environment
 
Interested in Architect and Framework
 
you can visit my blog : http://smack.kr/
 
articles for c#, framework, architect, and recommend books
but, only korean languages.
in the immediate future I will posts english version also.

Comments and Discussions

 
GeneralMy vote of 5 PinmemberRob 1234523-Oct-12 13:35 
GeneralCRC PinmemberAndreyMir28-Mar-09 18:55 
QuestionRe: CRC PinmemberComposition412-Apr-09 17:42 
GeneralAlternative approach Pinmemberdjlove26-Mar-09 11:39 
AnswerRe: Alternative approach PinmemberComposition426-Mar-09 16:41 
Generalmore tested 100,000,000 unique string for hashe value , collision not found yet PinmemberComposition422-Mar-09 13:56 
General"unique 64bit inteager" Pinmemberharold aptroot21-Mar-09 13:08 
GeneralRe: "unique 64bit inteager" Pinmemberassmax21-Mar-09 23:04 
AnswerRe: "unique 64bit inteager" PinmemberComposition422-Mar-09 4:43 
AnswerRe: "unique 64bit inteager" PinmemberComposition422-Mar-09 4:56 
GeneralRe: "unique 64bit inteager" Pinmemberharold aptroot22-Mar-09 5:56 

General General    News News    Suggestion Suggestion    Question Question    Bug Bug    Answer Answer    Joke Joke    Rant Rant    Admin Admin   

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.

| Advertise | Privacy | Mobile
Web02 | 2.8.140916.1 | Last Updated 20 Mar 2009
Article Copyright 2009 by Composition4
Everything else Copyright © CodeProject, 1999-2014
Terms of Service
Layout: fixed | fluid