CODEWITHSUNDEEP
c++cuda
El_Loco
El_Loco

Reputation: 1866

Vector on CUDA working on the Kernel

I am going to implement a way of creting 3D models on the GPU using CUDA. I did this several years ago, but I guess CUDA has developed since then, so I try to get some input on how to best do what I will do.

In my C++ version I have a vector of Voxels, where Voxel is a struct containing float numbers. The vector is supposed to represent an entire grid where I will do computations on each voxel independently.

Earlier, I had to used pointers and cudaMalloc and so forth in order to be able to access the voxels on the device. I am thinking about if there are some new features I can use.

Is there something like vector you can use on the actual kernel? Thrust is not suitable since it is supposed to be called from host.

More interestingly, is it possible to do dynamic memory allocation on the device, so that I could implement something like octrees on the GPU?

That would allow for larger scale reconstructions.

Any ideas are appreciated!

Edit:

It seems one has to stick with classic c-style coding using pointers and cudaMalloc, but dynamic memory allocation is possible.

Say I have this struct:

struct Data {
     float *p;
 }

and I start with an array 

Data data[10];

Then I want later to allocate an array of 30 floats in data[2] you would do something like

data[2].p = (float*)malloc(30*sizeof(float));

How would the code look like on Cuda?

Upvotes: 1

Views: 221

Answers (1)

talonmies
talonmies

Reputation: 72349

  1. Is there something like vector you can use on the actual kernel?

    Not really, no.

  2. is it possible to do dynamic memory allocation on the device, so that I could implement something like octrees on the GPU?

    Yes, dynamic memory allocation in device code was been supported on compute capability >= 2.0 devices for a number of years. Note that device heap memory allocation isn't particularly fast, so unless you have code which will re-use whatever allocations you make, there is going to be a performance penalty. Also note that you currently cannot access device heap from the host APIs, so if you need to transfer data back to the host, you need to do some additional work in a transfer kernel to move data from heap to global memory or a host zero copy/managed buffer.

Upvotes: 2

Related Questions