Based on AMD Zynq UltraScale+ MPSoC + NVIDIA Jetson Orin NX heterogeneous design, it meets the needs of the endoscope and surgical robot industry, with high-speed data transmission and AI computing processing; High definition video image acquisition and processing set, 8K high-definition video image display, 3D image processing; Synchronize left and right eye video data with a synchronization accuracy of 1 line; End to end delay within 50 milliseconds; Fluorescent and supports SDI/HDMI interfaces, etc
• Single channel video signal or 3D video signal output optional
• The time difference between left and right eye images is less than 100 microseconds
• Image delay within 50 milliseconds
• The output clarity shall not be lower than that of the host's direct output
• The output 3D image format needs to be able to meet both line by line and side by side 3D formats, facilitating display on different display devices, supporting picture in picture of different sizes, and allowing for free scaling of the main display page
• Brightness adjustment
• Color calibration
• photograph
• 3D parameter calibration
• Digital infinite zoom
• Switching between left and right eyes on the display screen
• Image rotation
• Fluorescence contrast adjustment
• Automatic white balance
• Supports H.264 and H.265 encoding and decoding
• Allow users to store backend static images and dynamic videos
• External switches or logic controls are used to switch between encoding and decoding functions
• The encoding end supports dual channel single frame merging for large frame encoding, and supports dual channel left and right eye single frame synchronization loop output
• H. 265 compression save or uncompressed save optional
• The decoding end supports large frame decoding and image splitting, outputting two synchronized left and right eye images, while looping out two left and right eye images connected to the display for preview
• Close up mode
• Ultra close range mode
• Different image enhancement modes can be provided according to different organizations to improve image contrast, such as vascular enhancement and contour enhancement
ALINX is based on the heterogeneous design of AMD Zynq UltraScale+MPSoC+NVIDIA Jetson Orin NX, capable of real-time 8K video streaming, 3D, fluorescence, and supporting SDI/HDMI interfaces and AI intelligent assistance. The 8K image sensor captures image information, and the captured video stream is processed and transmitted by Zynq UltraScale+MPSoC FPGA for video image signal processing. NVIDIA Jetson Orin NX performs AI computation, detection, and analysis on received video images. The processed high-definition video images are presented on a high-definition monitor through a display interface for surgeons to view, with clear color and a delay of less than 50 milliseconds
The surgical robot system with Zynq UltraScale+MPSoC FPGA as the core technology can achieve real-time 3D, multiple imaging modes, left and right eye image time difference less than 100 microseconds, 8K video stream, loop display, 100G fiber optic network transmission, and AI intelligent assistance. Local doctor assistance, 8K image sensor captures image information, Zynq UltraScale+MPSoC FPGA module performs image processing, and then transmits it to NVIDIA Jetson Orin NX for encoding, merging, and forwarding. It is then transmitted to remote NVIDIA Jetson Orin NX through a 100G fiber optic interface for reception, decomposition, and decoding, and displayed on a remote high-definition monitor for remote surgeons to view and operate
Based on the heterogeneous design of AMD Zynq UltraScale+MPSoC+NVIDIA Jetson Orin NX, it meets the requirements of high-speed data transmission, AI edge computing, professional high-definition 8K video image acquisition and processing, rich 12G-SDI, DP, HDMI video interfaces, 100G optical fiber interfaces, and is suitable for industrial and manufacturing, medical endoscopy and surgical robots, robot development, smart city, security and other fields of solutions
FPGA Chip
GPU
AI computility
8-channel bidirectional interface
HDMI 2.1 Input/Output
2-channel fiber optic interface
Logic Cells
PS DDR4 | PL DDR4
FPGA
Device:XCZU19EG-2FFVC1760I,packaged: FFVC1760
Logic Cells:1,143K,Flip-Flops:1,045K,LUTs:523K,Block RAM:34.6Mb,DSP Slices:1968,GTH:16.3Gb/s x44
CPU
Application processing unit:4x ARM Cortex-A53, 1.3GHz;
Real time processing unit:Dual core Cortex™-R5, 533MHz
GPU
Mali™-400 MP2,Frequency up to 667MHz
Cache | Storage
PS 8GB DDR4,PL 16GB DDR4 | 32GB eMMC FLASH,128MB QSPI FLASH
12G SDI Interface
8-channel bidirectional 12G SDI interface, supporting SD/HD/3G/6G/12G SDI rates, supporting up to 4K/60 frames of video input or output
100G Fiber optic interface
2 QSFP100G fiber optic interfaces, with a total data rate of 100Gbps per channel
Other interfaces
1 expansion port for FMC HPC, connecting various FMC modules externally; Gigabit Ethernet, JTAG, Uart and other interfaces
model
Jetson Orin NX 8GB (Optional selection)
Jetson Orin NX 16GB (Optional selection)
computility
70TOPS
100TOPS
CPU
6 cores NVIDIA Arm Cortex A78AE V8.2 64 bit CPU,2GHz
8 cores NVIDIA Arm Cortex A78AE V8.2 64 bit CPU,2GHz
GPU
1024 cores NVIDIA Ampere GPU with 32 Tensor Cores
1024 cores NVIDIA Ampere GPU with 32 Tensor Cores
Video Memory
8GB 128bit LPDDR5
16GB 128bit LPDDR5
video coding
1x 4K60 (H.265); 3x 4K30 (H.265 6x 1080p60 (H.265); 12x 1080p30 (H.265)
Video decoding
1x 8K30 (H.265); 2x 4K60 (H.265); 4x 4K30 (H.265); 9x 1080p60 (H.265); 18x 1080p30 (H.265)
DP display interface
1-channel Display Port output interface, used for displaying video images, supports up to 4K@30Hz or 1080P@60Hz Output
Other interfaces
NVMe M.2 SSD hard drive (self purchased) M.2 WIFI/BT、USB3.0、 Gigabit Ethernet and other interfaces