Click here to Skip to main content
Click here to Skip to main content

Parsing CSV embedded in double quotes - RFC 4180

, 3 May 2007
Rate this:
Please Sign up or sign in to vote.
Simple ways to parse CSV documents when values are embedded in double quotes.

Introduction

This is how CSV can be parsed when it is embedded in double quotes.

Background

The article in based on RFC 4180, which states that the standard CSV may contain values separated by comma and embedded in double quotes.

Take a look at the RFC here: http://tools.ietf.org/html/rfc4180.

The Code

// Code
/// <summary>
/// RFC 4180 Comma Seperated Values
/// http://tools.ietf.org/html/rfc4180
/// </summary>
/// <param name="line">Single line from CSV file</param>
public string[] SplitOnDoubleQuotes(string line)
{
    int i = 0;
    ArrayList occurs = new ArrayList();
    if (line.IndexOf('\n') <= 0)
        line = line + '\n';
    while (true)
    {
        if (line[i] == '\n')
            break;
        if (line[i] == ',')
            if (line[i-1] == '"' && line[i+1] == '"')
                occurs.Add(i);

        i++;
    }
    line= line.Remove(line.Length - 1);
    ArrayList tokens = new ArrayList();
    int startIdx =0;
    int endIdx;
    int len ;
    for(int t =0; t<= occurs.Count ; t++)
    {
        if (t != occurs.Count)
        {
            len = (int)occurs[t] - startIdx;
            tokens.Add((line.Substring(startIdx, len).StartsWith(
                ",") == true) ? line.Substring(startIdx, len).Remove(
                0,1):line.Substring(startIdx, len) );
            startIdx = (int)occurs[t];
        }
        else
        {
            tokens.Add((line.Substring(startIdx).StartsWith(",") == true) ?
                line.Substring(startIdx).Remove(0, 1) : line.Substring(
                startIdx));
        }
    }
    i=0;
    for (i = 0; i < tokens.Count;i++ )
    {
        string str = tokens[i].ToString();
        if (str.StartsWith("\"", StringComparison.Ordinal))
            str= str.Remove(0, 1);
        if (str.EndsWith("\""))
            str= str.Remove(str.Length - 1);
        tokens[i] = str;

    }
    return (string[])tokens.ToArray(typeof(string));
}

Points of Interest

There are many possible ways to do this, and this is just one of it.

Here are the possible ways:

  1. Define a Finite State Automata to parse the line character by character.
  2. Using String.Replace("\",\"",SpecialChar), replace the pattern with a special character value which is not possible to occur in your normal set of values in the CSV file.

I hope this code might have been useful for beginners.

License

This article, along with any associated source code and files, is licensed under The Common Development and Distribution License (CDDL)

About the Author

VaibhavGaikwad
Technical Lead
India India
Software developer by passion. Microsoft technologies is the prime area of work and interest. Work involves integrations and custom software development for healthcare and financial domains.
Follow on   Google+

Comments and Discussions

 
-- There are no messages in this forum --
| Advertise | Privacy | Mobile
Web01 | 2.8.140721.1 | Last Updated 3 May 2007
Article Copyright 2007 by VaibhavGaikwad
Everything else Copyright © CodeProject, 1999-2014
Terms of Service
Layout: fixed | fluid