seieric/gst-dsobjectsmask

📀NVIDIA DeepStream integrated GStreamer Plugin. Mask objects with cuda cores on Jetson boards. Fast and smooth since everything is done on NVMM.🏎

Gst-dsobjectsmask

This plugin masks objects detected by NVIDIA nvinfer plugin. Fast and smooth since all the masking processes are done with GPU. Originally forked from seieric/gst-dsobjectsmosaic.

Must be a better masking solution than masking with nvdsosd.

Note: This plugin is tested with PeopleSegNet, which is an instance segmentation model. Masking process refers to a object's mask_params of NvDsObjectMeta. Other models (e.g. semantic segmentation models) may not attach mask_params and this wouldn't work as expected.

Note: For Jetson only, not works with dGPU.

Features

• Mask objects with cuda
• Specify class ids for which blur should be applied
• Fast and smooth processing

Sample

Gst Properties

Property	Meaning	Type and Range
min-confidence	Minimum confidence of objects to be masked	Double, 0 to 1
class-ids	Class ids of objects for which masking should be applied	Semicolon delimited integer array

Depedencies

• DeepStream 6.1
• OpenCV4 with CUDA support

Download and Installation

If your environment satisfies the requirements, just run following commands.

git clone https://github.com/seieric/gst-dsobjectsmask.git
cd gst-dsobjectsmask
sudo make -j$(nproc) install

Example usage

This is a brief instruction to test this plugin after installtion.

1. Download NVIDIA-AI-IOT/deepstream_tao_apps to /opt/nvidia/deepstream/deepstream-6.1/sources/apps.
2. Download required models for deepstream_tao_apps. Refer to the documentation.
3. Build custom parser in /opt/nvidia/deepstream/deepstream-6.1/sources/apps/deepstream_tao_apps/post_processor.
4. Run the sample script samples/peoplesegnet_test.sh.
5. You will get the peoplesegnet_test.mp4 in your curennt directory.