CODEWITHSUNDEEP
hololensmrtk
tyro_0
tyro_0

Reputation: 23

How do I create a Mixed Reality Speech Command Profile for another language?

I am trying to create an application that can understand non english voice commands for Hololens2. I am trying to accomplish this without needing to go to the cloud as my use case cannot guarantee internet connectivity.

The documentation on Voice for Hololens 2 (https://learn.microsoft.com/en-us/windows/mixed-reality/voice-input) states:

"HoloLens 2 also supports additional languages. Keep in mind that speech commands will always run in the system's display language even if multiple keyboards are installed or if apps attempt to create a speech recognizer in a different language."

This seems to mean that a user can use non english voice commands to control Hololens 2. However I cannot find any documentation or any way to create a Mixed Reality Speech Command Profile that will work when supplied with non english commands. Is this functionality supported?

I have tried creating a custom Mixed Reality Speech Command Profile and providing it with Spanish or Japanese commands. However native speakers are unable to trigger these commands despite my code flagging that it has in fact heard the user say something.

Upvotes: 0

Views: 1079

Answers (1)

Franklin Chen - MSFT
Franklin Chen - MSFT

Reputation: 4923

For question that if there is a way to create a Mixed Reality speech command profile that will work when supplied with non English commands when running on English version HoloLens device.

The short answer is no. The language model for speech is based on the selected UI language and its dictionary is built on real words for that language, so the recognizer will not recognize foreign words without first switching the UI language to the appropriate native language. The premise is the HoloLens supports that native language.

The truth is only three languages is supported for HoloLens 1st Gen - English, Simplified Chinese and Japanese. The good news is the HoloLens 2nd Gen does have support for more languages than the original device. Please check out our official HoloLens 2 documentation: Supported languages for HoloLens 2

Upvotes: 0

Related Questions