Azure Kinect Green Screen

Question

I'm looking for sample code, or getting started to perform a "green screen" with the latest Azure Kinect DK.

• How should I proceed to build and display a color stream with ONLY body area ?
• Is it possible to avoid using body stream ? Because it require a stronger (NVidia computer)

Answer 1

We just published the new Green screen code sample as part of our GitHub open source repo microsoft/Azure-Kinect-Sensor-SDK. You can find more information at green screen example

If you have any questions about the code, you can open GitHub issue.

Answer 2

I just received my Azure Kinect device recently and have not yet tried a few things I am interested in so this reply comes not from direct experience, however sample code and the SDK's indicate there may be a viable approach.

You can always try to implement traditional color-recognition algorithms, but if your usage scenario allows it, you can use data from the depth camera to filter only data within a depth range, with the "green screen" being out of range. You can then correlate pixels from the depth camera to the RGB image data to pick out data from the color stream that is within a certain depth range. Also, the background does not have to be a real green screen, but rather just has to be outside of the filtered depth range.

This approach allows you to use the sensor SDK, not requiring the body tracking SDK and its associated GPU requirements.