CODEWITHSUNDEEP
awksedgrep
Programmer
Programmer

Reputation: 8717

Unix extract lines in between 2 lines and store them in respective files

I have a file like below in file allreport.txt:

11:22:33:456        Script started                  Running: first_script
11:22:34:456        GetData - Read                  Read 12 Bytes
11:22:34:456        SetData - Write                 Write 12 Bytes
11:32:33:456        Script started                  Running: second_script
11:32:34:456        GetData - Read                  Read 12 Bytes
11:32:34:456        SetData - Write                 Write 12 Bytes
11:42:33:456        Script started                  Running: third_script
11:42:34:456        GetData - Read                  Read 12 Bytes
11:42:34:456        SetData - Write                 Write 12 Bytes
11:52:33:456        Script started                  Running: fourth_script

My requirement is that I need to extract the '....' lines which are in between '*scripts'. I tried something like below:

grep 'Running:' allreport.txt | sed 's/[^ ]* //' | cut -d":" -f2 | tr '\n' ' ' | awk -v col=1 '/$col/,/$($col+1)/ allreport.txt  > $col'

But after execution of the command I see no output and no result files also created?

How can I achieve the same - the expected output is to have files like first_script, second_script and so on and each of the files contains logs of its run - example first_script should have below lines only:

11:22:34:456        GetData - Read                  Read 12 Bytes
11:22:34:456        SetData - Write                 Write 12 Bytes

Similarly second_script should have below lines and so on:

11:32:34:456        GetData - Read                  Read 12 Bytes
11:32:34:456        SetData - Write                 Write 12 Bytes

Upvotes: 2

Views: 103

Answers (5)

dawg
dawg

Reputation: 104062

You can use the csplit utility to split a file based on content:

csplit allrep.txt /[[:space:]]Running:[[:space:]]/ '{*}'
# produces xx00 - xxNN files based on that match

Some versions do not support '{*}'. If that is the case, you need to supply the number of splits in the {}. You could do:

csplit allrep.txt /[[:space:]]Running:[[:space:]]/ "{$(awk '/\sRunning:\s/{cnt++} END{print cnt-1}' allrep.txt)}"

If you want the file names, I would do something like this in awk:

awk 'BEGIN{fn="0000 - Header"}
{sub(/\r$/,"")}   # the file you uploaded has \r\n endings
$(NF-1)=="Running:" {close(fn); fn=sprintf("%04d - %s.txt", ++fc, $NF)}
{print >fn}
' allrep.txt

By adding a numeral in front, 1) that takes care of any dups and 2) allows you to see the order.

Upvotes: 2

tripleee
tripleee

Reputation: 189749

The immediate problem seems to be that you have some shell script code inside the quotes of your Awk script ... but also more fundamentally, your script is much too complex and weird.

awk '/Running:/ { close(c); c++; next }
    { print >c }' allreport.txt

Upvotes: 2

anubhava
anubhava

Reputation: 785721

You may try this awk also:

awk '$(NF-1) == "Running:" {close(fn); fn = $NF; next} {print > fn}' file

Upvotes: 3

RavinderSingh13
RavinderSingh13

Reputation: 133680

With your shown samples only, please try following. As an output it will create 3 files named first_script, second_script and third_script with shown samples.

awk -F': ' '/Running/{close(outFile);outFile=$2;next} {print > (outFile)}' Input_file

Explanation: Simple explanation would be, making field separator as : then checking if line has Running in it then set output file name as 2nd field. If line is NOT having Running then print that line into output file. Also making sure to close the output file in backend to avoid "too many opened files error" here.

Upvotes: 3

Ed Morton
Ed Morton

Reputation: 204259

$ awk 'sub(/.*Running: /,""){ close(out); out=$0; next } { print > out }' allreport.txt

$ head *script
==> first_script <==
11:22:34:456        GetData - Read                  Read 12 Bytes
11:22:34:456        SetData - Write                 Write 12 Bytes

==> second_script <==
11:32:34:456        GetData - Read                  Read 12 Bytes
11:32:34:456        SetData - Write                 Write 12 Bytes

==> third_script <==
11:42:34:456        GetData - Read                  Read 12 Bytes
11:42:34:456        SetData - Write                 Write 12 Bytes

Upvotes: 2

Related Questions