$ gst-launch-1.0 nvinferserver ERROR: pipeline could not be constructed: no element "nvinferserver".
왜 안되나 했는데 native하게 까는건 없는지 멀 하려고 하면 다 막히고, 걍 docker로 ㄱㄱ -_-
Can Gst-nvinfereserver (DeepSream Triton plugin) run on Nano platform? Yes. But due to Nano’s memory limitation, performance of certain models is slow and even run into OOM (out of memory) issues, specifically on heavy Tensorflow models. There is an option to run CPU instance for certain models on Nano. For more details, see samples/configs/deepstream-app-triton/README
$ sudo docker image ls REPOSITORY TAG IMAGE ID CREATED SIZE nvcr.io/nvidia/deepstream 6.0.1-triton ac5f4c456b5b 5 weeks ago 17.5GB nvcr.io/nvidia/deepstream-l4t 6.0.1-triton d3984db2b6b1 6 weeks ago 3.98GB
(gst-plugin-scanner:12): GStreamer-WARNING **: 01:40:47.344: Failed to load plugin '/usr/lib/aarch64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_osd.so': libnvbufsurface.so.1.0.0: cannot open shared object file: No such file or directory
(gst-plugin-scanner:12): GStreamer-WARNING **: 01:40:47.378: Failed to load plugin '/usr/lib/aarch64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_inferaudio.so': libcufft.so.10: cannot open shared object file: No such file or directory
(gst-plugin-scanner:12): GStreamer-WARNING **: 01:40:47.454: Failed to load plugin '/usr/lib/aarch64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_deepstream_bins.so': libnvdsbufferpool.so.1.0.0: cannot open shared object file: No such file or directory
(gst-plugin-scanner:12): GStreamer-WARNING **: 01:40:47.456: Failed to load plugin '/usr/lib/aarch64-linux-gnu/gstreamer-1.0/deepstream/libgstnvvideoconvert.so': libnvdsbufferpool.so.1.0.0: cannot open shared object file: No such file or directory
(gst-plugin-scanner:12): GStreamer-WARNING **: 01:40:47.477: Failed to load plugin '/usr/lib/aarch64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_preprocess.so': libnvbufsurface.so.1.0.0: cannot open shared object file: No such file or directory
(gst-plugin-scanner:12): GStreamer-WARNING **: 01:40:47.479: Failed to load plugin '/usr/lib/aarch64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_infer.so': libnvbufsurface.so.1.0.0: cannot open shared object file: No such file or directory
(gst-plugin-scanner:12): GStreamer-WARNING **: 01:40:47.490: Failed to load plugin '/usr/lib/aarch64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_multistream.so': libnvbufsurface.so.1.0.0: cannot open shared object file: No such file or directory
(gst-plugin-scanner:12): GStreamer-WARNING **: 01:40:47.499: Failed to load plugin '/usr/lib/aarch64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_ofvisual.so': libnvdsbufferpool.so.1.0.0: cannot open shared object file: No such file or directory
(gst-plugin-scanner:12): GStreamer-WARNING **: 01:40:47.508: Failed to load plugin '/usr/lib/aarch64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_dsexample.so': libnvbufsurface.so.1.0.0: cannot open shared object file: No such file or directory
(gst-plugin-scanner:12): GStreamer-WARNING **: 01:40:47.511: Failed to load plugin '/usr/lib/aarch64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_tracker.so': libnvbufsurface.so.1.0.0: cannot open shared object file: No such file or directory
(gst-plugin-scanner:12): GStreamer-WARNING **: 01:40:47.543: Failed to load plugin '/usr/lib/aarch64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_segvisual.so': libnvdsbufferpool.so.1.0.0: cannot open shared object file: No such file or directory
(gst-plugin-scanner:12): GStreamer-WARNING **: 01:40:47.619: Failed to load plugin '/usr/lib/aarch64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_inferserver.so': libnvbufsurface.so.1.0.0: cannot open shared object file: No such file or directory
(gst-plugin-scanner:12): GStreamer-WARNING **: 01:40:47.638: Failed to load plugin '/usr/lib/aarch64-linux-gnu/gstreamer-1.0/deepstream/libcustom2d_preprocess.so': libnvbufsurftransform.so.1.0.0: cannot open shared object file: No such file or directory
(gst-plugin-scanner:12): GStreamer-WARNING **: 01:40:47.660: Failed to load plugin '/usr/lib/aarch64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_udp.so': librivermax.so.0: cannot open shared object file: No such file or directory
(gst-plugin-scanner:12): GStreamer-WARNING **: 01:40:47.664: Failed to load plugin '/usr/lib/aarch64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_dewarper.so': libnvdsbufferpool.so.1.0.0: cannot open shared object file: No such file or directory
(gst-plugin-scanner:12): GStreamer-WARNING **: 01:40:47.667: Failed to load plugin '/usr/lib/aarch64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_multistreamtiler.so': libnvbufsurface.so.1.0.0: cannot open shared object file: No such file or directory No such element or plugin 'nvinferserver'
에라이 -_-
$ sudo docker image list REPOSITORY TAG IMAGE ID CREATED SIZE nvcr.io/nvidia/deepstream 6.0.1-triton ac5f4c456b5b 5 weeks ago 17.5GB nvcr.io/nvidia/deepstream-l4t 6.0.1-triton d3984db2b6b1 6 weeks ago 3.98GB
$ sudo docker run --rm -it ac5f4c456b5b /bin/bash WARNING: The requested image's platform (linux/amd64) does not match the detected host platform (linux/arm64/v8) and no specific platform was requested standard_init_linux.go:228: exec user process caused: exec format error
Building Jetson Containers on an x86 workstation (using qemu)
Element has no clocking capabilities. Element has no URI handling capabilities.
Pads: SINK: 'sink' Pad Template: 'sink' SRC: 'src' Pad Template: 'src'
Element Properties: name : The name of the object flags: readable, writable String. Default: "nvinferserver0" parent : The parent of the object flags: readable, writable Object of type "GstObject" qos : Handle Quality-of-Service events flags: readable, writable Boolean. Default: false unique-id : Unique ID for the element. Can be used to identify output of the element flags: readable, writable, changeable only in NULL or READY state Unsigned Integer. Range: 0 - 4294967295 Default: 0 process-mode : Inferserver processing mode, (0):None, (1)FullFrame, (2)ClipObject flags: readable, writable, changeable only in NULL or READY state Unsigned Integer. Range: 0 - 2 Default: 0 config-file-path : Path to the configuration file for this instance of nvinferserver flags: readable, writable, changeable in NULL, READY, PAUSED or PLAYING state String. Default: "" batch-size : Maximum batch size for inference flags: readable, writable, changeable only in NULL or READY state Unsigned Integer. Range: 0 - 1024 Default: 0 infer-on-gie-id : Infer on metadata generated by GIE with this unique ID. Set to -1 to infer on all metadata. flags: readable, writable, changeable only in NULL or READY state Integer. Range: -1 - 2147483647 Default: -1 infer-on-class-ids : Operate on objects with specified class ids Use string with values of class ids in ClassID (int) to set the property. e.g. 0:2:3 flags: readable, writable, changeable only in NULL or READY state String. Default: "" interval : Specifies number of consecutive batches to be skipped for inference flags: readable, writable, changeable only in NULL or READY state Unsigned Integer. Range: 0 - 2147483647 Default: 0 raw-output-generated-callback: Pointer to the raw output generated callback funtion (type: gst_nvinfer_server_raw_output_generated_callback in 'gstnvdsinfer.h') flags: readable, writable, changeable only in NULL or READY state Pointer. raw-output-generated-userdata: Pointer to the userdata to be supplied with raw output generated callback flags: readable, writable, changeable only in NULL or READY state Pointer.
[ 50%] Building CXX object CMakeFiles/triton-core.dir/backend_model_instance.cc.o In file included from /home/jetson/work/server/build/_deps/repo-core-src/src/backend_model_instance.cc:37:0: /home/jetson/work/server/build/_deps/repo-core-src/src/metrics.h:40:10: fatal error: dcgm_agent.h: No such file or directory #include <dcgm_agent.h> ^~~~~~~~~~~~~~ compilation terminated.
Known Issues Triton PIP wheels for ARM SBSA are not available from PyPI and pip will install an incorrect Jetson version of Triton for ARM SBSA. The correct wheel file can be pulled directly from the ARM SBSA SDK image and manually installed.
NOTE: To expand a source in the 2D tiled display and view object details, left-click on the source. To go back to the tiled display, right-click anywhere on the window.