Running Huge processes

Question

4.00/5 (1 vote)

See more:

Hi To All

Can anyone recommend some reading and research articles on how to maintain an application with tremendous memory usage.

Currently I have a biometrics project that with estimates will require a total memory usage of 32GB at its peak for just the biometric information.

And before you suggest putting it on a db is not an option as these need to be kept in the application memory for matching engines to identify the aquired minutae.

Thank you

Posted 28-Dec-12 1:02am

L Viljoen

Add a Solution

1 solution

Add a Solution

Add your solution here

Treat my content as plain text, not as HTML

Preview 0

…

Existing Members

Sign in to your account

...or Join us

Download, Vote, Comment, Publish.

Your Email
Password
Forgot your password?

Your Email
This email is in use. Do you need your password?
Optional Password

I have read and agree to the Terms of Service and Privacy Policy
Please subscribe me to the CodeProject newsletters

When answering a question please:

Read the question carefully.
Understand that English isn't everyone's first language so be lenient of bad spelling and grammar.
If a question is poorly phrased then either ask for clarification, ignore it, or edit the question and fix the problem. Insults are not welcome.
Don't tell someone to read the manual. Chances are they have and don't get it. Provide an answer or move on to the next question.

Let's work to help developers, not make them feel stupid.

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

Espen Harlinn · Accepted Answer · 2012-12-28T01:57:00

Solution 1

Just put more RAM into the computer - 32GB doesn't cost all that much anymore.

Alternatively rewrite the core of your application in C++, or any other language that gives you control over how memory is allocated - this may help, but exactly how much depends on how your data is organized.

Best regards
Espen Harlinn

Posted 28-Dec-12 1:57am

Espen Harlinn

Comments

Sergey Alexandrovich Kryukov 29-Dec-12 20:42pm

You are right, but one more problem: a motherboard may limit amount of memory boards and total memory. 5 anyway.
—SA

Espen Harlinn 30-Dec-12 5:36am

Thank you, Sergey :-D (BTW: Good point)

L Viljoen 31-Dec-12 2:33am

Also keep in mind that 32 bit processes are limited, so 64 bit would be needed. Its not so much a hardware issue as it is a infrastructure issue, you see the garbage collector in C# starts to take strain when the memory runs up to huge amounts