Click here to Skip to main content
14,027,272 members
Click here to Skip to main content
Articles » Database » Database » Utilities » Downloads

Stats

5.9M views
156K downloads
1.5K bookmarked
Posted 9 Jan 2005
Licenced MIT

A Fast CSV Reader

, 13 Jan 2016
A reader that provides fast, non-cached, forward-only access to CSV data.
CsvReader11_demo
CsvReader11_demo
CsvReader11_demo
CsvReaderBenchmarks
App.ico
data.rar
CsvReaderDemo
App.ico
LumenWorks.Framework.IO
Csv
Events
Exceptions
Resources
LumenWorks.Framework.Tests.Unit
IO
Csv
CsvReaderBenchmarks
App.ico
data.rar
CsvReaderDemo
App.ico
LumenWorks.Framework.IO
Csv
Events
Exceptions
Resources
LumenWorks.Framework.Tests.Unit
IO
Csv
CsvReaderBenchmarks
App.ico
data.rar
CsvReaderDemo
App.ico
LumenWorks.Framework.IO
Csv
Events
Exceptions
Resources
LumenWorks.Framework.Tests.Unit
IO
Csv
CsvReader11_src
CsvReader11_src
CsvReader11_src
LumenWorks.Framework.IO
Csv
Events
Exceptions
Resources
LumenWorks.Framework.Tests.Unit
IO
Csv
LumenWorks.Framework.IO
Csv
Events
Exceptions
Resources
LumenWorks.Framework.Tests.Unit
IO
Csv
LumenWorks.Framework.IO
Csv
Events
Exceptions
Resources
LumenWorks.Framework.Tests.Unit
IO
Csv
CsvReader20_demo
CsvReader20_demo
CsvReader20_demo
CsvReaderBenchmarks
bin
Release
CsvReaderBenchmarks.exe
CsvReaderBenchmarks.vshost.exe
LumenWorks.Framework.IO.dll
data.rar
Properties
CsvReaderDemo
bin
Release
CsvReaderDemo.exe
LumenWorks.Framework.IO.dll
LumenWorks.Framework.Tests.Unit.dll
Properties
LumenWorks.Framework.IO
bin
Release
LumenWorks.Framework.IO.dll
LumenWorks.Framework.IO.XML
Csv
Events
Exceptions
Resources
Properties
LumenWorks.Framework.Tests.Unit
bin
Release
LumenWorks.Framework.IO.dll
LumenWorks.Framework.Tests.Unit.dll
IO
Csv
Properties
CsvReaderBenchmarks
bin
Release
CsvReaderBenchmarks.exe
LumenWorks.Framework.IO.dll
data.rar
Properties
CsvReaderDemo
bin
Release
CsvReaderDemo.exe
LumenWorks.Framework.IO.dll
LumenWorks.Framework.Tests.Unit.dll
Properties
LumenWorks.Framework.IO
bin
Release
LumenWorks.Framework.IO.dll
LumenWorks.Framework.IO.XML
Csv
Events
Exceptions
Resources
Properties
LumenWorks.Framework.Tests.Unit
bin
Release
LumenWorks.Framework.IO.dll
LumenWorks.Framework.Tests.Unit.dll
IO
Csv
Properties
CsvReaderBenchmarks
bin
Release
CsvReaderBenchmarks.exe
LumenWorks.Framework.IO.dll
data.rar
Properties
CsvReaderDemo
bin
Release
CsvReaderDemo.exe
LumenWorks.Framework.IO.dll
LumenWorks.Framework.Tests.Unit.dll
Properties
LumenWorks.Framework.IO
bin
Release
LumenWorks.Framework.IO.dll
LumenWorks.Framework.IO.XML
Csv
Events
Exceptions
Resources
Properties
LumenWorks.Framework.Tests.Unit
bin
Release
LumenWorks.Framework.IO.dll
LumenWorks.Framework.Tests.Unit.dll
IO
Csv
Properties
CsvReader20_src
CsvReader20_src
CsvReader20_src
LumenWorks.Framework.IO
bin
Release
LumenWorks.Framework.IO.dll
LumenWorks.Framework.IO.XML
Csv
Events
Exceptions
Resources
Properties
LumenWorks.Framework.Tests.Unit
bin
Release
LumenWorks.Framework.IO.dll
LumenWorks.Framework.Tests.Unit.dll
IO
Csv
Properties
LumenWorks.Framework.IO
bin
Release
LumenWorks.Framework.IO.dll
LumenWorks.Framework.IO.XML
Csv
Events
Exceptions
Resources
Properties
LumenWorks.Framework.Tests.Unit
bin
Release
LumenWorks.Framework.IO.dll
LumenWorks.Framework.Tests.Unit.dll
IO
Csv
Properties
LumenWorks.Framework.IO
bin
Release
LumenWorks.Framework.IO.dll
LumenWorks.Framework.IO.XML
Csv
Events
Exceptions
Resources
Properties
LumenWorks.Framework.Tests.Unit
bin
Release
LumenWorks.Framework.IO.dll
LumenWorks.Framework.Tests.Unit.dll
IO
Csv
Properties
LumenWorks.Framework.IO.dll
LumenWorks.Framework.IO.XML
CsvReaderDemo
CsvReaderDemo
bin
Release
CsvReaderDemo.exe
CsvReaderDemo.vshost.exe
LumenWorks.Framework.IO.dll
data.rar
Properties
CsvReaderTests
bin
Release
CsvReaderTests.dll
LumenWorks.Framework.IO.dll
Properties
LumenWorks.Framework.IO
bin
Release
LumenWorks.Framework.IO.dll
Csv
Exceptions
Resources
Properties
benchmark.xls
benchmark.xls
bin
Release
CsvReaderDemo.exe
CsvReaderDemo.vshost.exe
LumenWorks.Framework.IO.dll
LumenWorks.Framework.Tests.Unit.dll
Properties
CsvReaderDemoWeb
bin
CsvReaderDemoWeb.dll
LumenWorks.Framework.IO.dll
LumenWorks.Framework.IO.XML
LumenWorks.Framework.Tests.Unit.dll
Properties
LumenWorks.Framework.IO
bin
Release
LumenWorks.Framework.IO.dll
LumenWorks.Framework.IO.XML
Csv
Events
Exceptions
Resources
LumenWorks.Framework.snk
Properties
LumenWorks.Framework.Tests.Unit
bin
Release
LumenWorks.Framework.IO.dll
LumenWorks.Framework.Tests.Unit.dll
IO
Csv
Properties
CsvReaderBenchmarks
bin
Release
CsvReaderBenchmarks.exe
CsvReaderBenchmarks.vshost.exe
LumenWorks.Framework.IO.dll
data.rar
Properties
CsvReader - No cache :           4747087372 clocks, 1.5863 sec., 27.7377 MB/sec.
CachedCsvReader - Run 1 :        9827320545 clocks, 3.2839 sec., 13.3987 MB/sec.
CachedCsvReader - Run 2 :        2016217 clocks, 0.0007 sec., 65307.2164 MB/sec.
OleDb :                          66551980350 clocks, 22.2390 sec., 1.9785 MB/sec.
Regex :                          47155626307 clocks, 15.7575 sec., 2.7923 MB/sec.

Test pass #1 - Field #72 (middle)

CsvReader - No cache :           3137658241 clocks, 1.0485 sec., 41.9655 MB/sec.
CachedCsvReader - Run 1 :        9178558372 clocks, 3.0671 sec., 14.3458 MB/sec.
CachedCsvReader - Run 2 :        264645 clocks, 0.0001 sec., 497547.7338 MB/sec.
OleDb :                          39567405915 clocks, 13.2218 sec., 3.3278 MB/sec.
Regex :                          20044703715 clocks, 6.6981 sec., 6.5690 MB/sec.


Test pass #2 - All fields

CsvReader - No cache :           4580648048 clocks, 1.5307 sec., 28.7456 MB/sec.
CachedCsvReader - Run 1 :        9738510239 clocks, 3.2542 sec., 13.5209 MB/sec.
CachedCsvReader - Run 2 :        194475 clocks, 0.0001 sec., 677071.7059 MB/sec.
OleDb :                          64768631693 clocks, 21.6431 sec., 2.0330 MB/sec.
Regex :                          45526857097 clocks, 15.2132 sec., 2.8922 MB/sec.

Test pass #2 - Field #72 (middle)

CsvReader - No cache :           3078253058 clocks, 1.0286 sec., 42.7754 MB/sec.
CachedCsvReader - Run 1 :        9423161452 clocks, 3.1488 sec., 13.9734 MB/sec.
CachedCsvReader - Run 2 :        260055 clocks, 0.0001 sec., 506329.5072 MB/sec.
OleDb :                          38391777173 clocks, 12.8290 sec., 3.4297 MB/sec.
Regex :                          20335039966 clocks, 6.7952 sec., 6.4752 MB/sec.


Test pass #3 - All fields

CsvReader - No cache :           4547893793 clocks, 1.5197 sec., 28.9526 MB/sec.
CachedCsvReader - Run 1 :        11245674772 clocks, 3.7579 sec., 11.7088 MB/sec.
CachedCsvReader - Run 2 :        268672 clocks, 0.0001 sec., 490090.2215 MB/sec.
OleDb :                          64499526848 clocks, 21.5532 sec., 2.0415 MB/sec.
Regex :                          45028835326 clocks, 15.0468 sec., 2.9242 MB/sec.

Test pass #3 - Field #72 (middle)

CsvReader - No cache :           3025870973 clocks, 1.0111 sec., 43.5159 MB/sec.
CachedCsvReader - Run 1 :        9367579290 clocks, 3.1303 sec., 14.0563 MB/sec.
CachedCsvReader - Run 2 :        271440 clocks, 0.0001 sec., 485092.5435 MB/sec.
OleDb :                          38857261447 clocks, 12.9845 sec., 3.3886 MB/sec.
Regex :                          20159534730 clocks, 6.7365 sec., 6.5316 MB/sec.


Done

By viewing downloads associated with this article you agree to the Terms of Service and the article's licence.

If a file you wish to view isn't highlighted, and is a text file (not binary), please let us know and we'll add colourisation support for it.

License

This article, along with any associated source code and files, is licensed under The MIT License

Share

About the Author

Sebastien Lorion
Architect
Canada Canada
Sébastien Lorion is software architect as day job.

He is also a musician, actually singing outside the shower Smile | :)

He needs constant mental and emotional stimulation, so all of this might change someday ...

You may also be interested in...

Permalink | Advertise | Privacy | Cookies | Terms of Use | Mobile
Web02 | 2.8.190419.4 | Last Updated 13 Jan 2016
Article Copyright 2005 by Sebastien Lorion
Everything else Copyright © CodeProject, 1999-2019
Layout: fixed | fluid