Seth Kitchen
Seth Kitchen

Reputation: 1566

How to add LateX/Math to Windows 10 Ink API?

From highlights of Microsoft Build 2016, I saw Microsoft was pushing its new Ink API.

Jeans link refers to custom recognition. Is this what I'm looking for? I feel like there should be an option to add symbols to the lookup dictionary.

Upvotes: 7

Views: 930

Answers (3)

Muzib
Muzib

Reputation: 2581

For LaTex, there's a Xamarin library called CSharpMath, which uses SkiaSharp to render the math expression. It is ported from the iosMath project.

As the library is .NetStandard, so it also means you can use it in an UWP app. The repository can be found here.

Upvotes: 1

nrocha
nrocha

Reputation: 394

-Understand handwriting and digitize it?

Yes, that's the whole point of the API.

It's basically OCR 2.0

-Understand Math/Equations and digitize it (ie Latex)?

Nope. Or, at least, not yet because, of course, it would be a logical expansion of the API.

Are there any other APIs that can do this for UWP or Unity?

Not that I had heard of.

Finally, I don't think that Jeans link is what you are looking for. It's not simply a matter of adding a new symbol, but also to represent it conveniently.

For example, how would you do to display \frac{\,\frac{a}{b}\,}{\frac{c}{d}} ?

There is no correct way of positioning the a/b over the fraction bar and the c/d under it. Even if you can use superscript and subscript, there is no way for a standard police to align them vertically.

The good news is: Ink is an API, which means you could create a wrapper that would, for example, automate the latex pdf generation. So yes, you could create the functionality you're looking for with a bit on C# (as it looks you're on a Microsoft environment)

Take a look at this thread: https://tex.stackexchange.com/questions/53914/compile-tex-inside-microsoft-c-net

Best of luck!

Upvotes: 2

Yes for the first point, you can convert ink strokes to text using handwriting recognition.

Recognize ink strokes

For math and equations, didn't see any default Recognizer at the moment.

Upvotes: 3

Related Questions