CODEWITHSUNDEEP
c++stringutf-16
ronag
ronag

Reputation: 51255

Check if all characters in UTF16 string are valid?

I have a problem where I have UTF16 strings (std::wstring) that might have "invalid" characters which causes my console terminal to stop printing (see question).

I wonder if there is a fast way to check all the characters in a string and replace any invalid chars with ?.

I know I could do something along these lines with a regex, but it would be difficult to make it validate all valid chars, and also slow. Is there e.g. a numeric range for the char codes that I might use e.g. all char codes between 26-5466 is valid?

Upvotes: 1

Views: 1269

Answers (2)

Emilio Garavaglia
Emilio Garavaglia

Reputation: 20730

I suspect your problem is not related to the validity of characters, but to the capability of the console to print them.

The definition UNICODE does to "printable" does not necessarily coincide to the effective capability of the console itself to "print".

Character like '€' are "printable" but -for example- not on winXP consoles.

Upvotes: 0

Dietmar Kühl
Dietmar Kühl

Reputation: 153792

It should be possible to use std::ctype<wchar_t> to determine if a character is printable:

std::local loc;
std::replace_if(string.begin(), string.end(),
                [&](wchar_t c)->bool { return !std::isprint(c, loc); }, L'?');

Upvotes: 2

Related Questions