Description
We need to add the ability to access raw frames inside a DeepStream pipeline. This allows us to apply custom operations outside of the standard DeepStream plugins (as a part of callback functions). Try to use a pipeline as simple as possible (e.g. without a nvinfer inside, try to remove the "heavy" elements from it), but having important elements (nvvideoconvert).
As a reference, please use the way of creating the deepstream pipeline as in test_onnx_pipeline.py (element factory, adding to the bin, etc).
Links:
Tasks
- Identify the correct probe/hook/callback point in the pipeline (e.g., pad probe after
nvvidconv).
- Implement code to extract raw frames from the pipeline.
- Demonstrate a simple manipulation on the part of the frame (e.g., flip, brightness change, or drawing text).
- Document the mechanism clearly for future extensions.
DoD
Description
We need to add the ability to access raw frames inside a DeepStream pipeline. This allows us to apply custom operations outside of the standard DeepStream plugins (as a part of callback functions). Try to use a pipeline as simple as possible (e.g. without a nvinfer inside, try to remove the "heavy" elements from it), but having important elements (nvvideoconvert).
As a reference, please use the way of creating the deepstream pipeline as in
test_onnx_pipeline.py(element factory, adding to the bin, etc).Links:
Tasks
nvvidconv).DoD
docs/access_raw_frames.md.