CODEWITHSUNDEEP
visual-studiocloudload-testing
Tam Minh
Tam Minh

Reputation: 43

VS Cloud Load Test: Results are different (too much) each time run using same script

Update 2

I resolved it by recording the new webtest, creating new loadtest file and run again. I don't know why but now it works and the number makes more sense.

Update 1

As comment from #AdrianHHH, I run another test with 120 users and see that the average page time reduce to 3.6s. This is our staging and I never finish loading within 5s before :(.

Web server info:

Is the VS Cloud Load Test result reliable or not?

[Fouth run]

=====================================================

Original post

I'm running a simple load test script to access my webpage with 100 users.

In my opinion, the Total Requests should be same if I run same script (same number of user, same config), but it does not.

I also attaches 3 pics that I used same script to run.

Please help. Thanks.

First run

Second run

Third run

Upvotes: 0

Views: 122

Answers (1)

AdrianHHH
AdrianHHH

Reputation: 14038

There is no reason to expect identical results. Your tests run via network links that you have little control over and other network traffic may cause delays. Your tests run on servers where the processing times may vary depending on their other work. Load tests often include "think times" and Visual Studio provides a way of varying them to imitate the different speeds of different people.

The average page times and average response times vary widely between the three test runs. That supports the supposition that other factors are influencing the tests. To me these times are more worrying than the total requests.

Upvotes: 1

Related Questions