CODEWITHSUNDEEP
c#jmeterload-testingweb-testing
Kevin Brydon
Kevin Brydon

Reputation: 13102

Load testing a website

I am currently writing a small application to load test a website and am having a few problems.

List<string> pageUrls = new List<string();
// NOT SHOWN ... populate the pageUrls with thousands of links

var parallelOptions = new System.Threading.Tasks.ParallelOptions();
parallelOptions.MaxDegreeOfParallelism = 100;
System.Threading.Tasks.Parallel.ForEach(pageUrls, parallelOptions, pageUrl =>
{
    var startedOn = DateTime.UtcNow;

    var request = System.Net.HttpWebRequest.Create(pageUrl);

    var responseTimeBefore = DateTime.UtcNow;

    try
    {
        var response = (System.Net.HttpWebResponse)request.GetResponse();
        responseCode = response.StatusCode.ToString();
        response.Close();
    }
    catch (System.Net.WebException ex)
    {
        // NOT SHOWN ... write to the error log
    }

    var responseTimeAfter = DateTime.UtcNow;

    var responseDuration = responseTimeAfter - responseTimeBefore;

    // NOT SHOWN ... write the response duration out to a file

    var endedOn = DateTime.UtcNow;

    var threadDuration = endedOn - startedOn;

    // sleep for one second
    var oneSecond = new TimeSpan(0, 0, 1);
    if (threadDuration < oneSecond)
    {
        System.Threading.Thread.Sleep(oneSecond - threadDuration);
    }
}
);

When I set the MaxDegreeOfParallelism to a low value such as 10 everything works fine, the responseDuration stays between 1 and 3 seconds. If I increase the value to 100 (as in the example) the responseDuration climbs quickly until after around 300 requests the it has reached 25 seconds (and still climbing).

I thought I may be doing something wrong so I also ran Apache jMeter with the standard web test plan setup and set the users to 100. After about 300 samples the response times had rocketed to around 40 seconds.

I'm skeptical that my server is reaching its limit. The task manager on the server shows that only 2GB of the 16GB is being used and the processor hangs around 5% effort.

  1. Could I be hitting some limit on the number of simultaneous connections on my client computer? If so, how do I change this?
  2. Am I forgetting to do something in my code? Clean-up/close connections?
  3. Could it be that my code is OK and it is in fact my server that just can't handle the traffic?

For reference my client computer that is running the code above is running Windows 7 and is on the same network as the server I am testing. The server is running Windows Server 2008 IIS 7.5 and is a dedicated 8-core 16GB RAM machine.

Upvotes: 2

Views: 1590

Answers (2)

BenTester
BenTester

Reputation: 46

Several suggestions:

  1. How large is your recorded Jmeter test script and did you insert some think time? The larger the test, the heavier the load.
  2. Make sure the LAN is not in use by competing traffic during test runs. Having a Gigabit ethernet switch should be mandatory.
  3. Do use 2-3 slave machines and avoid using heavy results loggers in Jmeter like tree.You were right to minimize these graphs and results.

Upvotes: 1

humblelistener
humblelistener

Reputation: 1456

MaxDegreeOfParallelism should be used only when you are trying to limit the number of cores to be used as part of your program strategy.

By default, Parallel library utilizes the most number of available threads - so setting this option to any number mostly will limit the performance depending on the environment running it.

I would suggest you to try running this code without setting this option and that should improve the performance.

ParallelOptions.MaxDegreeOfParallelism Property in MSDN - read remarks section for more information.

Upvotes: 2

Related Questions