CODEWITHSUNDEEP
cudaresourcesgpgpu
yanxi
yanxi

Reputation: 23

Maximum instructions per CUDA kernel? Maximum operations per CUDA stream?

Is there maximum number of CUDA operations which may be pending for a specific CUDA stream? I haven't seen such a limit in any documentation.

I am also interested in the related figure of the maximum number of instructions per CUDA kernel.

Upvotes: 2

Views: 1193

Answers (1)

BenC
BenC

Reputation: 8976

There is a maximum number of CUDA PTX instructions per kernel:

  • 2 million for GPUs with Compute Capability under 2.0 (i.e. before the Fermi microarchitecture)
  • 512 million for GPUs with Compute Capability 2.0 or higher (e.g. Fermi, Kepler, Maxwell, ...)

This information can be found in the CUDA C Programming Guide, just look for "Maximum number of instructions per kernel".

As for streams, if the kernels that run on a given stream respect this limit, there is no such stream instruction limit. As @talonmies pointed out, streams are a host side queue of operations, they have nothing to do with loading code onto the GPU.

Upvotes: 3

Related Questions