Studio Video

Studio is a powerful tool for visualizing both data and video. The video plugin allows you to view the video devices on the bus, display their real time video feed, flip and mirror the feed, and overlay LiDAR points or lane model objects if they are available.

Opening video plugin and viewing a video stream

To use the video plugin first open up PolySync Studio.

$ polysync-core-studio

Then click on “Video” in the “Launch Plugin” right-hand sidebar. The video plugin should open up as shown below. If video devices are present on the bus, then you may select one of them in the “Image Data Sources” box in the left-hand sidebar. Sometimes it takes a few seconds for the video to decode and start displaying. Once the feed is up, you can flip or mirror the video, as well as overlay LiDAR or lane model objects if they are available on the bus. Image width and height, pixel format of the incoming video, and the system name is also displayed.

Studio Video

Overlaying primitives

In order to overlay objects─LiDAR points and lane model markings─it is necessary to configure the publishing nodes (video device) focal length and mount positions (x/y/z and roll/pitch/yaw).

The focal length is just another parameter that can be found under the video device node’s “Sensor Configuration” section, in the SDF Configurator:

ID: 1099, Name: "Video Device 0 Focal Length"

The focal length needs to be calculated on a per-image-sensor and lens combination basis.