CODEWITHSUNDEEP
phpmysqlsqlmultiple-matches
PaxBin
PaxBin

Reputation: 111

Find Matches in MySQL by uknown common Words

I'm working on a MYSQL table in which i have thousands (20 thousand) of issues reported by users collected in the last 2 years. And now I have to treat this reported issues separately.

The problem I am facing is that many of these reported issues are similar (I mean a lot of them). And I would like to find matches in the the table.

And the problem I'm having here again, is that the "reported issues" are written manually, so they differ from each other. but matches may contain Some common words

So I am wondering if there is a way to find matches in the MySQL table by common words.

What I am trying to do here is to retrieve similar rows (that mach in many keywords) without using any specific keywords

Is there any tool to do that? Is there a way to do that?

I am open also to all kind of php scripts that my work, Thank you in advance

Upvotes: 0

Views: 102

Answers (1)

Cups
Cups

Reputation: 6896

I'd start off by asking someone with Domain Knowledge for their absolute top 2 or 3 recurring problems. They should be able to just reel these off.

Ask them to supply you with the terms and synonyms used in those 2 or 3 main problems, else you will have to do this yourself.

Clone the table and put a FULLTEXT index on it and see how effective fulltext search is in identifying matching issues.

I would be surprised if this does not yield pretty good results from the corpus, but if they are not good enough then you might want to wander into the field of NLP (Natural Language Processing) - a more natural fit for that would be the toolset that you can use with Python though.

Another alternative is to build in some kind of tagging system, but the best ones rely on human intervention and their success depends largely on how well the GUI is built.

Upvotes: 0

Related Questions