WSO2 CEP : 4.2.0 receiver slower than 4.1.0

Question

I have tested HTTP receiver with both WSO2 CEP 4.1.0 & 4.2.0. With same set of data, streams, execution plan(just event count wit 1 min window), publisher(logger) 4.1.0 is able to process 1M/minute but 4.2.0 could go up to 200K-300K/minute.

Have conducted the same test with my custom file receiver and found similar result as above.

By the way, I have tested it on my laptop, 3 MB file with 10 Millions records.

Is there anybody face same issue ?
Appreciate if anybody can explain the issues behind this ?

Thanks, Obaid

Obaid · Accepted Answer

Just completed the test and have a feeling that logger publisher in 4.2.0 is the culprit here. Please find below outcomes and share your opinion (M=Million):

HTTP Receiver only push to Event Stream:
- Both 4.1 & 4.2 was able to push 2.25M events/minute.
HTTP Receiver + below execution plan + logger:
- 4.1: 1.25M events/minute.
- 4.2: 250K events/minute.
HTTP Receiver + below execution plan + "NO" logger:
- 4.1: 2.25M events/minute.
- 4.2: 2.25M events/minute.
Custom File Receiver + below execution plan + "NO" logger:
- 4.1: 1.5M events/minute.
- 4.2: 3M events/minute (I am surprised).

Execution Plan:

@Import('subsApps:1.0.0')
define stream subsApps (meta_app_name string, correlation_imsi long, volume double);

@Export('subsCount:1.0.0')
define stream subsCount (meta_counts long);

from subsApps#window.time( 1 min ) 
select count() as meta_counts 
insert into subsCount;

WSO2 CEP : 4.2.0 receiver slower than 4.1.0

Answers (2)

Execution Plan:

Related Questions