I am looking for a step by step guide to extract the API calls made by some specific application (I want to this to malware) so that I can store those API calls later in somewhere like a database.
I need this information to make a fuzzy set (Fuzzy Logic in AI) to do this:
I test a limited 800 malwares.
I extract the API calls and keep them somewhere.
Now I have a new untested malware.
I extract the API calls. --->
if more than 20% of the extracted API calls by that malware matches with those in the database then the file is Risky (based on fuzzy logic)
This mechanism is based on guessing so it must NOT be 100% accurate.
Please if you can help give me some guides, I'm not looking for any source code.
If the information I provided is not clear enough please let me know in comment to improve it.