CODEWITHSUNDEEP
ibm-cloudibm-watsonwatson-assistant
qkhanhpro
qkhanhpro

Reputation: 5230

IBM Watson Assistant for non-English language - Intent is not recognized

I am working with IBM Watson Asistant for Korean and found the failure rate to detect the correct intent is so high. Therefore, I decided to check language support and I can see the important missing features that is Entity Fuzzy Matching:

Partial match - With partial matching, the feature automatically suggests substring-based synonyms present in the user-defined entities, and assigns a lower confidence score as compared to the exact entity match.

This result in the chatbot that is not very intelligent for which we need to provide synonyms for each word. Check out the example below where Watson Assistant in English can detect an intent from words that is not included in the example by any means. I tested and found it is not possible for Korean language to do so.

I wonder If I understood something wrong or there is away to workaround this issue that I do not know of?

enter image description here

Upvotes: 0

Views: 407

Answers (2)

Vidyasagar Machupalli
Vidyasagar Machupalli

Reputation: 2865

In addition to Henrik's answer, here are couple of tips while creating an intent

  1. Provide at least five examples for each intent.
  2. Always re-train your system

If the system does not recognize the correct intent, you can correct it. To correct the recognized intent, select the displayed intent and then select the correct intent from the list. After your correction is submitted, the system automatically retrains itself to incorporate the new data.

  1. Remember, The Watson Assistant service scores each intent’s confidence independently, not in relation to other intents.
  2. Avoid conflicts and if there are any resolve the conflicts - The Watson Assistant application detects a conflict when two or more intent examples in separate intents are so similar that Watson Assistant is confused as to which intent to use.

Upvotes: 2

data_henrik
data_henrik

Reputation: 17176

By default, you start with IBM Watson Assistant and an untrained dialog. You can significantly improve the understood intents and entities by providing more examples and then using the dashboard to tag correctly understood conversations and to change incorrect intents / entities to the right ones. This is the preferred way and is just part of the regular development process which includes training the model.

Another method, this time as workaround, is to preprocess a dialog using Watson Natural Language Understanding which has Korean support, too.

BTW: I use German language for some of my bots and it requires training for some scenarios.

Upvotes: 2

Related Questions