xlnx-nlp-smartvision

The natural language processing (NLP) SmartVision application implements keyword spotting (KWS) on processing system (PS) and face detection, object detection, and license plate detection running on the DPU in the programmable logic (PL). It showcases keyword based dynamic switching between multiple tasks and modifying display properties.

This snap includes both the KV260 firmware (bitstream, xclcin) and nlp-smartvision application. It requires the KV260 Vision AI Starter Kit to execute - it is NOT compatible with ZCU10x boards. In addition, the xlnx-config snap must be in stalled in the system.

Note: The nlp-smartvision sub-application requires access to a either the USB web camera or MIPI camera to provide real-time video inference for the various models. The snap also requires access to a USB microphone or USB webcam microphone to capture live audio and perform natural language processing to control the demo application. Therefore, the following interfaces will be auto-connected: alsa, camera, media-ctrl