Reputation: 1009
I know that CUDA kernels can be "overlapped" by putting them into separate streams, but I'm wondering if would it be possible to transfer memory during kernel executions. CUDA kernels are asynchronous afterall
Upvotes: 3
Views: 372
Reputation: 384
Just for clarification, the above are valid only if your device supports it. You can check it running device query and checking the attribute concurrent copy and execution
Upvotes: 1
Reputation: 15734
You can run kernels, transfers from host to device and transfers from device to host concurrently.
http://developer.download.nvidia.com/CUDA/training/StreamsAndConcurrencyWebinar.pdf
Upvotes: 2