CODEWITHSUNDEEP
cudanvidia
Muhammad Ali
Muhammad Ali

Reputation: 438

Jetson TK1 Multiple Streams parallel execution

Considering that Tk1 has single SM, is it really possible to run streams concurrently ? I have been unable to do so, even with latest vesions of cuda libraries.

So is it really possible ? any sample code would be great. The sample code under cuda Blas also runs sequential as show on visual profiler.

Also a better insight into what "Streams" are good for in a Single SM ?

[Already asked on nvidia dev forum, the forum isnt very active i think]

Upvotes: 1

Views: 206

Answers (1)

Florent DUGUET
Florent DUGUET

Reputation: 2916

With a single Kepler SM, it is not possible to run several streams concurrently. Kepler does not support preemption. This is not related to a CUDA version, rather related to the capability of the SM. Something related to preemption has be discussed for Pascal at GTC 2016, but nothing before.

Regarding the actual use of streams with single SM, some async functions may behave slightly differently between stream 0 and other streams. Hence, I assume some corner case of async memcopy and execution might benefit from streams with single SM - as TK1 device query reads that it has concurrent copy and exec with 1 copy engine. (even though it might be that ZeroCopy is a better approach on TK1).

Upvotes: 1

Related Questions