How do I search for similar words?

Question

0.00/5 (No votes)

See more:

I have a list of words that needs to be searched in documents etc, to see if they exists. The problem is, there are two words that are very similar, namely, "confidential" and "co-confidential". So, how to check and ensure that they do not mix these words up when searching? For "secret" and "restricted", those have no issues.

What I have tried:

static List<string> keywords = new List<string> {"secret", "restricted", "confidential", "co-confidential"};

 static bool ContainsAny(this string haystack, params string[] needles)
        {
            foreach (string needle in needles)
            {
                if (haystack.Contains(needle))
                {
                    if (haystack.Contains(needle))
                    {
                        if ((needle.StartsWith("co-")) && needle.EndsWith("ial"))
                            return true;

                        else if ((needle.StartsWith("co")) && needle.EndsWith("ial"))
                            return true;

                        else if (haystack.Contains(needle) && !(needle.StartsWith("co")) && needle.EndsWith("ial"))
                            return true;
                        else
                            return false;
                       
                    }
                    else
                        return false;

                }
                else
                    return false;


            }

            return false;
        }

static string GetUntilOrEmpty(this string text, string stopAt = "-")
        {
            if (!String.IsNullOrWhiteSpace(text))
            {
                int charLocation = text.IndexOf(stopAt, StringComparison.Ordinal);

                if (charLocation > 0)
                {
                    return text.Substring(0, charLocation);
                }
            }

            return String.Empty;
        }

        public static bool Validate_Text(this string source, string toCheck)
        {
            bool bl_found = false;
            try
            {

                //if either strings are null or empty
                if (string.IsNullOrEmpty(toCheck) || string.IsNullOrEmpty(source))
                {
                    return false;
                }

                bl_found = ContainsAny(source, toCheck);


            }
            catch (ArgumentNullException e)
            {
               Console.WriteLine("Keyword/ Content is null" + e.Message.ToString());
                return false;
            }
            catch (ArgumentException e)
            {
                Console.WriteLine("Keyword/ Content: Error" + e.Message.ToString());
                return false;
            }


            return bl_found;

        }

The output is as follows:

====Normal Directory======
Keyword: confidential  File path: c:\users\stk2017\desktop\testfolder\C.docx
Keyword: confidential  File path: c:\users\stk2017\desktop\testfolder\C.pptx
Keyword: confidential  File path: c:\users\stk2017\desktop\testfolder\C.xlsx
Keyword: confidential  File path: c:\users\stk2017\desktop\testfolder\Cc.docx
Keyword: co-confidential  File path: c:\users\stk2017\desktop\testfolder\Cc.docx
Keyword: confidential  File path: c:\users\stk2017\desktop\testfolder\Cc.pptx
Keyword: co-confidential  File path: c:\users\stk2017\desktop\testfolder\Cc.pptx
Keyword: confidential  File path: c:\users\stk2017\desktop\testfolder\Co-confid.docx
Keyword: co-confidential  File path: c:\users\stk2017\desktop\testfolder\Co-confid.docx
Keyword: confidential  File path: c:\users\stk2017\desktop\testfolder\Co.pptx
Keyword: co-confidential  File path: c:\users\stk2017\desktop\testfolder\Co.pptx
Keyword: confidential  File path: c:\users\stk2017\desktop\testfolder\doc.xlsx
Keyword: co-confidential  File path: c:\users\stk2017\desktop\testfolder\doc.xlsx
Keyword: confidential  File path: c:\users\stk2017\desktop\testfolder\Testing.docx
============Done===============

Posted 9-Jun-22 17:44pm

pohcb_sonic

Updated 10-Jun-22 9:06am

v3

Add a Solution

Comments

PIEBALDconsult 10-Jun-22 22:10pm

"co-confidential" is not a word. Done.

2 solutions

Add a Solution

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

Dave Kreskowiak · Answer 1 · 2022-06-09T17:58:00

Solution 1

" confidential " and " co-confidential ".
Note spaces before and after the words.

Punctuation is a problem there.

I would probably try using a regex to do this, not a simple Contains method.

Posted 9-Jun-22 17:58pm

Dave Kreskowiak

Updated 9-Jun-22 18:04pm

v2

Comments

pohcb_sonic 10-Jun-22 0:08am

any examples as reference? I did tried regex, but it doesn't work.

Dave Kreskowiak 10-Jun-22 7:40am

I don't have an example, but you're looking to build a regex expression that matches your search terms with whitespace characters at the start of the word.

Google for "Expresso regex" and you'll find a tool for building regex expressions and be able to test them against sample data.

ludosoep · Answer 2 · 2022-06-10T09:06:00

Hi, is it correct that you only want to know if one of these words occur without actually knowing the word it concerns? In that case matching "confidential" is enough for matching both "confidential" and "co-confidential".

If you need to know exactly which words occur in the document you can use regex (fast), but you can also use a simply split on the text. Something like:

C#

var keywords = new List<string> {"secret", "restricted", "confidential", "co-confidential"};
var words = documentText.Split(' ');
var hits = new Dictionary<string, int>();
foreach (var word in words) {
  //***** Remove punctuations and eliminate casing;
  var keyword = word.Trim('.', ',', '!', '?');
  if (keywords.Contains(keyword)
    if (hits.ContainsKey(keyword))
      hits[keyword]++;
    else
      hits.Add(keyword, 1);
}

HTH

How do I search for similar words?

2 solutions

Solution 1

Solution 2

Add your solution here

Preview 0

How do I search for similar words?

2 solutions

Solution 1

Solution 2

Add your solution here

Preview 0

Existing Members

...or Join us