Click here to Skip to main content
11,492,907 members (62,221 online)
Click here to Skip to main content

C#.NET – Removing Duplicate Records From DataTable

, 13 Feb 2013 CPOL 36.2K 11
Rate this:
Please Sign up or sign in to vote.
A function to remove and select unique records from a DataTable in C#.NET and return a clean and duplicate-free DataTable.

Introduction

If a database table contain duplicate records the it is easy to select unique records by using DISTINCT function. but when a .NET DataTable contains duplicate records then, there is no built-in function to remove or select unique records from a DataTable.

Objective

The main goal of this article is to create a function and removes and select unique records from a DataTable in C#.NET and return a clean and duplicate free DataTable.

Explanation

For removing duplicate records from DataTable, I have create the below funciton which needs two parameters, DataTable and Column Name. This function is searching for duplicate records in DataTable given column name from second parameter and adding the row (record) in an ArrayList variable. Then, the record will be deleted from the datatable by running a loop on founded duplicate records.

DataTable contain duplicate records:
duplicates

Function for removing duplicate records from DataTable

/// <summary>
/// Remove duplicate records from data table
/// </summary>
/// <param name="table">DataTable for removing duplicate records</param>
/// <param name="DistinctColumn">Column to check for duplicate values or records</param>
/// <returns></returns>
public DataTable RemoveDuplicateRows(DataTable table, string DistinctColumn)
{
    try
    {
        ArrayList UniqueRecords = new ArrayList();
        ArrayList DuplicateRecords = new ArrayList();

        // Check if records is already added to UniqueRecords otherwise,
        // Add the records to DuplicateRecords
        foreach(DataRow dRow in table.Rows)
        {
            if (UniqueRecords.Contains(dRow[DistinctColumn]))
                DuplicateRecords.Add(dRow);
            else
                UniqueRecords.Add(dRow[DistinctColumn]);
        }

        // Remove dupliate rows from DataTable added to DuplicateRecords
        foreach (DataRow dRow in DuplicateRecords)
        {
            table.Rows.Remove(dRow);
        }

        // Return the clean DataTable which contains unique records.
        return table;
    }
    catch (Exception ex)
    {
        return null;
    }
}

Using the function

It is very easy to use this function, all you need is to pass the datatable and column name parameters to the function and the function returns the cleaned datatable

Example

DataTable DuplicateRecords = objDatabase.getTable("SQL Query");
DataTable UniqueRecords = RemoveDuplicateRows(DuplicateRecords, "Column Name to check for duplicate records");

Clean and duplicate free DataTable using the above function:

 cleaned

Remarks

The above function is selecting the first record and deleting others if duplicate record is found in DataTable.

Conclusion

By using this function you will be able to clean your datatable from duplicate records.

Feel free to comment, suggest or give your feedback.

The post C#.NET – Removing Duplicate Records From DataTable appeared first on Noor Ahmad Feroozi.

License

This article, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

Share

About the Author

Noor Ahmad Feroozi
Software Developer (Senior) Ministry of Education
Afghanistan Afghanistan
No Biography provided
Follow on   Twitter   Google+

Comments and Discussions

 
Questionthanks Pin
loveleshsgsits19-Mar-15 8:02
memberloveleshsgsits19-Mar-15 8:02 
QuestionAnother simple and fast method for RemoveDuplicatesRecords Pin
satindersinght6-Mar-13 20:42
membersatindersinght6-Mar-13 20:42 
GeneralMy vote of 5 Pin
bandi.ramesh16-Feb-13 0:17
memberbandi.ramesh16-Feb-13 0:17 
SuggestionWhat do you think about this codes? Pin
LightEach14-Feb-13 15:04
memberLightEach14-Feb-13 15:04 
QuestionIs this column based? Pin
ortund14-Feb-13 1:37
memberortund14-Feb-13 1:37 
QuestionHow about multiple column unique? Pin
johnchen8813-Feb-13 9:59
memberjohnchen8813-Feb-13 9:59 
AnswerRe: How about multiple column unique? Pin
Noor Ahmad Feroozi13-Feb-13 10:31
memberNoor Ahmad Feroozi13-Feb-13 10:31 
AnswerRe: How about multiple column unique? Pin
Richard Beatty20-Jan-15 8:56
memberRichard Beatty20-Jan-15 8:56 
QuestionWorks perfectly Pin
Gorata11-Feb-13 0:30
memberGorata11-Feb-13 0:30 
SuggestionAlternative technique 2 Pin
RogerDW8-Feb-13 6:04
memberRogerDW8-Feb-13 6:04 
GeneralRe: Alternative technique 2 Pin
thatraja4-Feb-14 2:52
mvpthatraja4-Feb-14 2:52 
SuggestionAlternative technique 1 Pin
RogerDW8-Feb-13 6:00
memberRogerDW8-Feb-13 6:00 

General General    News News    Suggestion Suggestion    Question Question    Bug Bug    Answer Answer    Joke Joke    Rant Rant    Admin Admin   

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.

| Advertise | Privacy | Terms of Use | Mobile
Web01 | 2.8.150520.1 | Last Updated 13 Feb 2013
Article Copyright 2013 by Noor Ahmad Feroozi
Everything else Copyright © CodeProject, 1999-2015
Layout: fixed | fluid