CODEWITHSUNDEEP
c#performancethrottling
Ram
Ram

Reputation: 11644

Data throttling C#

I am using thirdparty component which accepts maximum 25KB data at a time. I am passing array of the objects to this third party component from my application.

However the amount of data that my application writes is much more than 25KB. I am retrieving data from database and calling the component directly.

I have added reference of the component in the application. The data I am passing to the component as array of object which contains primitive and non primitive types.

How can I implement the data throttling here?

Upvotes: 5

Views: 389

Answers (3)

Dominic Zukiewicz
Dominic Zukiewicz

Reputation: 8444

Have a look at the BufferedStream class example in MSDN. You should be able to adapt it so that you write 25KB maximum per second.

When writing to stream, you specify a data size to read/write, so if you say write 25KB and it returns 24KB, you know you can still write 1K.

If it comes back with 25KB and there is still data outstanding in the buffer, you can do a Thread.Sleep(1000) to ensure it does not exceed the quota.

Upvotes: 2

Boris B.
Boris B.

Reputation: 5024

You must implement a data buffer between your app and the component. The best way to do that is to:

  • make a class that has it's own internal thread,
  • on the public part of the class' interface implement Write method which accepts a byte array and stores it to a queue
  • internal thread writes up to 25kb chunk of data from queue the and sleeps for 1 second, minus the time it took to write the chunk.

You also must take care, if the data stream is continuous and is produced at a rate > 25kbps, then you produce more then the component can consume and your queue will overflow.

Upvotes: 3

Florian
Florian

Reputation: 5994

You can calculate the size of the one row in your database. After that every time you pass something you add that size to a variable. At the same time you are using a Stopwatch that runs. Just check if the Stopwatch.EllapsedSeconds is bigger than 1 second. If yes reset the Stopwatch and reset your variable with the size you ve already passed. If not check if the size you ve already passed (the amount of variable) is bigger than 25KB. If that is true call System.Thread.Thread.Sleep(Math.Max(1000 - StopWatch.EllapsedMilliseconds, 0)). But remember you have to do that in an extra thread because sleep blocks the whole thread.

Upvotes: 5

Related Questions