reading a large data from file

Question

0.00/5 (No votes)

See more:

I want to write a C code that reads billions of integers from a text file. Each integer is of length 10 digits (e.g. -2311872000). then I build a linked list to store these integers.how could I do that ?

Posted 25-Oct-13 2:01am

3bood.ghzawi

Updated 25-Oct-13 4:49am

Richard MacCutchan

v2

Add a Solution

Comments

W∴ Balboos, GHB 25-Oct-13 8:10am

First, find out the data-block capacity of your system (4GB per billion reads, minimum); Also, be certain that you can create an index offset of sufficient size for the number of values you plan to read. The text file, itself, would seem to be rather large, as well (up to 10GB/billion values) - does it already exist or are you only planning on this exercise.

A 64-bit O/S (or more) would be a good idea about now.

1 solution

Add a Solution

Add your solution here

Treat my content as plain text, not as HTML

Preview 0

…

Existing Members

Sign in to your account

...or Join us

Download, Vote, Comment, Publish.

Your Email
Password
Forgot your password?

Your Email
This email is in use. Do you need your password?
Optional Password

I have read and agree to the Terms of Service and Privacy Policy
Please subscribe me to the CodeProject newsletters

When answering a question please:

Read the question carefully.
Understand that English isn't everyone's first language so be lenient of bad spelling and grammar.
If a question is poorly phrased then either ask for clarification, ignore it, or edit the question and fix the problem. Insults are not welcome.
Don't tell someone to read the manual. Chances are they have and don't get it. Provide an answer or move on to the next question.

Let's work to help developers, not make them feel stupid.

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

CPallini · Accepted Answer · 2013-10-25T02:13:00

Apart of the crazy resource-consuming requirements (every 'billion' of integers translates to, at least, 4 GB of memory), what is the purpose of storing the integers in a linked list?
In any case, the bulk of your task is relatively simple, build a linked list (see, for instance "C Linked List Data Structure Explained with an Example C Program"[^] and store the read integers in.