CODEWITHSUNDEEP
javastringtokentokenizestringtokenizer
cafesanu
cafesanu

Reputation: 465

Tokenizer in java dealing with spaces and apostorophes

I was wondering if there is any way in Java to tokenize an string by spaces, BUT if there are some words between apostrophes, take it as "one word"...

so for example, if I have:

This "is a great" day

the string tokenizer should have:

Thanks!

Upvotes: 1

Views: 316

Answers (1)

DNA
DNA

Reputation: 42597

Using String.split() and a regex, not a StringTokenizer, how about:

    String input = "this \"is a great\" day";

    for (String  word: input.split("(?<=\").+(?=\")|\\b\\w+\\b"))
    {
        System.out.println("["+word+"]");
    }

Output:

[this]
[is a great]
[day]

From your example, I assume you mean double-quotes (") not apostrophes (').

NB: I initially posted something much simpler, which worked for your example, but not for input like: 

" yes this \"is a great\" day all right"

Upvotes: 2

Related Questions