How to find occurrence while patterns are overlapping

Question

Context: It is a log analysis thing. I am creating a regex program to find occurrence of certain requests send to a server from a client. I have the client log file containing these requests along with other logs.

Problem: When a request message is send to server, the client should have 2 log statements like:

sending..
message_type

when the above statements or pattern found we can say one request has been sent.It is combined pattern. Ok

We are expecting the log file content will be like

sending..
message_type
...//other text
sending..
message_type
...//other text
sending..
message_type

From the above log we can say client has sent 3 messages. But in the actual log file somehow, the patterns are overlapping as below(not for all messages, but for some):

sending..(1)
...//other text
sending..(2)
message_type(2)
...//other text
message_type(1)
sending..(3)
message_type(3)

Still 3 requests(i numbered messages to understand). But the pattern is overlapped.i.e before logging first message fully , second message got logged. The above explanation is for understanding. Below is the part of original log:

Original log

Send message to server:
Created post notification log dir
Created post notification log dir
Created post notification log dir
Send message to server:
Created post notification log dir

INFO [a] - Server Response: 

INFO [a] - Server Response:

here as per the explanation single request will be identified with its 2 parts:

Send message to server:

What I tried

public class LogMatcher {   

    static final String create_session= "Send message to server(.){10,1000}(<\?xml(.){10,500}type="createsession"(.){1,100})";



    public static void main(String[] args) throws IOException {
        BufferedReader reader = new BufferedReader(new InputStreamReader(new FileInputStream(new File("D:/dummy.txt"))));//I put the above log in this file
        StringBuilder b = new StringBuilder();
        String line = "";
        while((line = reader.readLine()) != null ){     
            b.append(line);
        }

        findMatch(b,"Send message to server","Send message to server");
        findMatch(b,create_session,"create_session");

    }
    private static int findMatch(StringBuilder b,String pattern, String type) {
        int count =0;
        Pattern regex = Pattern.compile(pattern,Pattern.MULTILINE);
        Matcher regexMatcher = regex.matcher(b.toString());
        while (regexMatcher.find()) {
            count++;
        } 
        System.out.printf("%25s%2d
",type+": ",count);
        return count;
    }
}

Current Output

Intention is to find out the number of createsession messages sent

Send message to server:  2
        create_session:  1

Expected output

From the log it is clear that 2 messages sent.So out put will be:

 Send message to server:  2
         create_session:  2

You can see the pattern I have tried in my code. Can anyone suggest a pattern to get the desired result?

Note: One can simply say why not use the count Send message to server alone. Because in the log there are many type of messages like login, closesession etc. All of them having the first part as Send message to server.Also they have logged message types alone for some other purpose so we can't relay on any part(meaning only the combination we could relay on)

How to find occurrence while patterns are overlapping

Answers (1)

Related Questions