Latency refers to the delay between the moment a camera captures a scene and when that scene is displayed on the viewer’s device. In embedded vision systems, latency is a critical factor – as important as high-resolution imaging. Both directly impact the accuracy and responsiveness of decision-making, which is important in time-sensitive applications such as AI-driven security systems, autonomous vehicles, or automated quality inspection systems.
In this blog, you’ll learn how e-con Systems’ embedded camera, combined with Lattice’s Holoscan Sensor Bridge and e-con Systems’ TintE ISP, achieves low-latency transmission on NVIDIA Jetson Orin platforms.
About e-con Systems’ e-CAM85_CUHSB
The e-CAM85_CUHSB camera is integrated with the NVIDIA Holoscan Sensor Bridge (HSB), which leverages Lattice’s FPGA technology and e-con Systems’ TintE ISP and Holoscan Sensor IP on the NVIDIA Jetson Orin platforms. This collaborative solution offers broad interface support and high-throughput packetisation for AI acceleration on the NVIDIA Jetson AGX Orin platform.
This camera is also designed to be compatible with the NVIDIA Jetson Thor series, which delivers up to 2070 FP4 TFLOPS for Edge AI applications like humanoid robots.
Now, let us first understand what the Lattice HSB board is, and then we will delve into its data processing pipeline – both with NVIDIA’s user’ ISP and with the TintE ISP.
What is a Holoscan Sensor Bridge – and how does it work?
The Holoscan Sensor Bridge provides an FPGA-based interface that uses GPU RDMA (remote direct memory access) and high-speed Ethernet to enable low-latency sensor data processing. The Lattice Holoscan Sensor Bridge board incorporates two powerful Lattice FPGAs, each playing a specialised role: CrossLink-NX FPGA handles the reception of high-bandwidth MIPI camera data, while the other CertusPro-NX FPGA is responsible for transmitting this data at multi-gigabit speeds over 10G SFP+ Ethernet ports.
It can also be adapted to a single FPGA architecture in production to simplify the design and improve efficiency, although the Lattice HSB setup utilises two FPGAs for flexible development and testing. It’s a ready-to-use, configurable Holoscan Sensor Bridge IP, paired with the Holoscan software to deliver a sensor-agnostic data-to-Ethernet host platform. This IP simplifies and accelerates FPGA design while offering scalability and configurability to adapt to various sensor-to-host applications.
The board is compatible with the Jetson AGX Orin through socket-based Ethernet connections and the Jetson IGX Orin platforms through ROCE. It supports high-speed data transmission via dual 10G SFP+ Ethernet ports for seamless camera integration.
Read the full article at e-con Systems.
