CFileException m_cause 0 (none)

Question

0.00/5 (No votes)

See more:

I am trying to build a log analyzer which reads each log file one by one (may extend to more than 500 text files of 2 MB each).
Every time I open a log file, parse it, separate all the logs according to each thread. close the CStdioFile pointer and then delete it. ( So there is only one log file opened at any point of time for reading)

Parsing:
I have a map which has key as threadID (integer) and second as a file pointer. (I create a separate file for each thread, earlier i used to store each log entry in vector whose pointer I stored in second of this map, but now using files because of memory issues)

I have implemented logic to close 100 file pointers(from beginning of map) whenever total open files reach 500. So at any point of time only 500 files are open, (NO THREADING ISSUE)

Everything works fine for reasonable number of threads (about 700-800), but after that CStdioFile is unable to open any new or existing file for no reason, and throws CFileException with
m_cause =0(none).

Point at which exception is thrown is not defined, sometimes it may go upto creating 1500 files and sometimes as low as 800.

I am unable to find any particular reason for this.

Thanks in advance..

Posted 13-Mar-13 10:17am

Member 9716938

Add a Solution

Comments

nv3 13-Mar-13 17:06pm

Sorry, but I found it hard to follow the story. In the first paragraph you say that there is only one log file open at a time. Then you describe that you close a hundred files whenever the number of open files exceeds 500. You have one file per thread and 700-800 threads, but only 500 files open. Perhaps you can explain all that a little more detailed.

Regarding the exception: What have you done to analyze it? Can you reproduce it in a debugger session? (That would allow you to look around at variable values and probably see the problem relatively quickly.) Have you tried to catch the exception and do some debug prints? Just ideas about what you can do to solve this case.

Just an idea: When the problem occurs when opening a file after some 800 or 1500 open operations, I would suspect that your file closing is not working properly and you are running into the limit of maximum open files. But this is just a guess.

chaau 13-Mar-13 21:05pm

I suggest you monitor your program using a tool as easy accessible as task manager. In the task manager use View->Select Columns. There, select Thread Count, Handle Count, memory related columns, GDI Handles (I doubt they are involved). View the numbers when error happens. I bet one of them will be unusually high

Add your solution here

Treat my content as plain text, not as HTML

Preview 0

…

Existing Members

Sign in to your account

...or Join us

Download, Vote, Comment, Publish.

Your Email
Password
Forgot your password?

Your Email
This email is in use. Do you need your password?
Optional Password

I have read and agree to the Terms of Service and Privacy Policy
Please subscribe me to the CodeProject newsletters

When answering a question please:

Read the question carefully.
Understand that English isn't everyone's first language so be lenient of bad spelling and grammar.
If a question is poorly phrased then either ask for clarification, ignore it, or edit the question and fix the problem. Insults are not welcome.
Don't tell someone to read the manual. Chances are they have and don't get it. Provide an answer or move on to the next question.

Let's work to help developers, not make them feel stupid.

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)