CODEWITHSUNDEEP
bashremoving-whitespace
Charlie
Charlie

Reputation: 2291

How to remove extra spaces in bash?

How to remove extra spaces in variable HEAD?

HEAD="    how to  remove    extra        spaces                     "

Result:

how to remove extra spaces

Upvotes: 49

Views: 78465

Answers (10)

Oleksandr S.
Oleksandr S.

Reputation: 2034

Works in BASH

echo variable without quotes does what you want:

HEAD="    how to  remove    extra        spaces      "
echo $HEAD

# or assign to new variable
NEW_HEAD=$(echo $HEAD)
echo $NEW_HEAD

output: how to remove extra spaces

Upvotes: 1

kojiro
kojiro

Reputation: 77157

This horse isn't quite dead yet: Let's keep beating it!*

Read into array

Other people have mentioned read, but since using unquoted expansion may cause undesirable expansions all answers using it can be regarded as more or less the same. You could do

set -f
read HEAD <<< $HEAD
set +f

or you could do

read -rd '' -a HEAD <<< "$HEAD"  # Assuming the default IFS
HEAD="${HEAD[*]}"

Extended Globbing with Parameter Expansion

$ shopt -s extglob
$ HEAD="${HEAD//+( )/ }" HEAD="${HEAD# }" HEAD="${HEAD% }"
$ printf '"%s"\n' "$HEAD"
"how to remove extra spaces"

*No horses were actually harmed – this was merely a metaphor for getting six+ diverse answers to a simple question.

Upvotes: 11

F1Linux
F1Linux

Reputation: 4383

Whitespace can take the form of both spaces and tabs. Although they are non-printing characters and unseen to us, sed and other tools see them as different forms of whitespace and only operate on what you ask for. ie, if you tell sed to delete x number of spaces, it will do this, but the expression will not match tabs. The inverse is true- supply a tab to sed and it will not match spaces, even if the number of them is equal to those in a tab.

A more extensible solution that will work for removing either/both additional space in the form of spaces and tabs (I've tested mixing both in your specimen variable) is:

echo $HEAD | sed 's/^[[:blank:]]*//g'

or we can tighten-up @Frontear 's excellent suggestion of using xargs without the tr:

echo $HEAD | xargs

However, note that xargs would also remove newlines. So if you were to cat a file and pipe it to xargs, all the extra space- including newlines- are removed and everything put on the same line ;-).

Both of the foregoing achieved your desired result in my testing.

Upvotes: 2

Frontear
Frontear

Reputation: 1261

I would make use of tr to remove the extra spaces, and xargs to trim the back and front.

TEXT="     This          is  some                             text   "
echo $(echo $TEXT | tr -s " " | xargs)

# [...]$ This is some text

Upvotes: 1

lisrael1
lisrael1

Reputation: 399

echo -e " abc \t def "|column -t|tr -s " "

column -t will:

  1. remove the spaces at the beginning and at the end of the line
  2. convert tabs to spaces

tr -s " " will squeeze multiple spaces to single space

BTW, to see the whole output you can use cat - -A: shows you all spacial characters including tabs and EOL:

echo -e " abc \t def "|cat - -A

output: abc ^I def $

echo -e " abc \t def "|column -t|tr -s " "|cat - -A

output: abc def$

Upvotes: 3

jman
jman

Reputation: 11616

Try this: 

echo "$HEAD" | tr -s " "

or maybe you want to save it in a variable:

NEWHEAD=$(echo "$HEAD" | tr -s " ")

Update

To remove leading and trailing whitespaces, do this:

NEWHEAD=$(echo "$HEAD" | tr -s " ")
NEWHEAD=${NEWHEAD%% }
NEWHEAD=${NEWHEAD## }

Upvotes: 54

ndbroadbent
ndbroadbent

Reputation: 13803

Here's how I would do it with sed:

string='    how to  remove    extra        spaces                     '
echo "$string" | sed -e 's/  */ /g' -e 's/^ *\(.*\) *$/\1/'

=> how to remove extra spaces   # (no spaces at beginning or end)

The first sed expression replaces any groups of more than 1 space with a single space, and the second expression removes any trailing or leading spaces.

Upvotes: 7

Shoo Limberger
Shoo Limberger

Reputation: 386

Try this one:

echo '    how to  remove    extra        spaces                     ' | sed 's/^ *//g' | sed 's/$ *//g' | sed 's/   */ /g'

or

HEAD="    how to  remove    extra        spaces                     "
HEAD=$(echo "$HEAD" | sed 's/^ *//g' | sed 's/$ *//g' | sed 's/   */ /g')

Upvotes: 2

glenn jackman
glenn jackman

Reputation: 247092

Take advantage of the word-splitting effects of not quoting your variable

$ HEAD="    how to  remove    extra        spaces                     "
$ set -- $HEAD
$ HEAD=$*
$ echo ">>>$HEAD<<<"
>>>how to remove extra spaces<<<

If you don't want to use the positional paramaters, use an array

ary=($HEAD)
HEAD=${ary[@]}
echo "$HEAD"

One dangerous side-effect of not quoting is that filename expansion will be in play. So turn it off first, and re-enable it after:

$ set -f
$ set -- $HEAD
$ set +f

Upvotes: 15

Guru
Guru

Reputation: 17024

Using awk:

$ echo "$HEAD" | awk '$1=$1'
how to remove extra spaces

Upvotes: 38

Related Questions