CODEWITHSUNDEEP
pythonstringsplit
Rob
Rob

Reputation: 8080

Don't split double-quoted words with Python string split()?

When using the Python string function split(), does anybody have a nifty trick to treat items surrounded by double-quotes as a non-splitting word?

Say I want to split only on white space and I have this:

>>> myStr = 'A B\t"C" DE "FE"\t\t"GH I JK L" "" ""\t"O P   Q" R'
>>> myStr.split()
['A', 'B', '"C"', 'DE', '"FE"', '"GH', 'I', 'JK', 'L"', '""', '""', '"O', 'P', 'Q"', 'R']

I'd like to treat anything within double-quotes as a single word, even if white spaces are embedded, so would like to end up with the below:

['A', 'B', 'C', 'DE', 'FE', 'GH I JK L', '', '', 'O P   Q', 'R']

Or at least this and then I'll strip off the double-quotes:

['A', 'B', '"C"', 'DE', '"FE"', '"GH I JK L"', '""', '""', '"O P   Q"', 'R']

Any non-regex suggestions?

Upvotes: 13

Views: 8733

Answers (3)

PabloG
PabloG

Reputation: 26745

@Rob: why without regexes if the regexp solution is so simple?

my_str = 'A B\t"C" DE "FE"\t\t"GH I JK L" "" ""\t"O P   Q" R'
print re.findall(r'(\w+|".*?")', my_str)
['A', 'B', '"C"', 'DE', '"FE"', '"GH I JK L"', '""', '""', '"O P   Q"', 'R']

Upvotes: 4

Sven Marnach
Sven Marnach

Reputation: 602635

You won't be able to get this behaviour with str.split(). If you can live with the rather complex parsing it does (like ignoring double quotes preceded by a back slash), shlex.split() might be what you are looking for:

>>> shlex.split(myStr)
['A', 'B', 'C', 'DE', 'FE', 'GH I JK L', '', '', 'O P   Q', 'R']

Upvotes: 36

hochl
hochl

Reputation: 12960

I suggest you search with re for the pattern "[^"]*" and apply string.split only on the remaining parts. You could implement a recursive function that processes all relevant string parts.

Upvotes: 0

Related Questions