CODEWITHSUNDEEP
cudagpgpu
caesar
caesar

Reputation: 181

What are the factors that affect CUDA kernels launch time

I have a set of CUDA kernels. Each kernel completes its job in less than 10 microsec, however, its launch time is 50-70 microsec. I am suspecting the use of texture memory might be the reason, since it is used in my kernels.

Are there any recommendations to reduce the launch time of CUDA kernels? In general, what are the factors that affect the kernel launch time?

Upvotes: 1

Views: 1359

Answers (1)

user1084944
user1084944

Reputation:

You can reduce the overall launch time by launching fewer kernels; e.g. if you launch several kernels in sequence, you could write a new single kernel that does all of that work in a single launch.

From the very little bit of context currently in the question, I suspect this is your problem; you are doing too little work per kernel.

(my next guess is an error in benchmark; i.e. the times aren't for what you think they are)

Upvotes: 2

Related Questions