Solution

< Back to list

Medical Endoscope and Surgical Robot Solution

Based on AMD Zynq UltraScale+ MPSoC + NVIDIA Jetson Orin NX heterogeneous design, it meets the needs of the endoscope and surgical robot industry, with high-speed data transmission and AI computing processing; High definition video image acquisition and processing set, 8K high-definition video image display, 3D image processing; Synchronize left and right eye video data with a synchronization accuracy of 1 line; End to end delay within 50 milliseconds; Fluorescent and supports SDI/HDMI interfaces, etc



1.jpg



3D video support

  • • Single channel video signal or 3D video signal output optional

  • • The time difference between left and right eye images is less than 100 microseconds

  • • Image delay within 50 milliseconds

  • • The output clarity shall not be lower than that of the host's direct output

  • • The output 3D image format needs to be able to meet both line by line and side by side 3D formats, facilitating display on different display devices, supporting picture in picture of different sizes, and allowing for free scaling of the main display page

High speed and precise image processing

  • • Brightness adjustment

  • • Color calibration

  • • photograph

  • • 3D parameter calibration

  • • Digital infinite zoom

  • • Switching between left and right eyes on the display screen

  • • Image rotation

  • • Fluorescence contrast adjustment

  • • Automatic white balance

High definition encoding, decoding, and storage

  • • Supports H.264 and H.265 encoding and decoding

  • • Allow users to store backend static images and dynamic videos

  • • External switches or logic controls are used to switch between encoding and decoding functions

  • • The encoding end supports dual channel single frame merging for large frame encoding, and supports dual channel left and right eye single frame synchronization loop output

  • • H. 265 compression save or uncompressed save optional

  • • The decoding end supports large frame decoding and image splitting, outputting two synchronized left and right eye images, while looping out two left and right eye images connected to the display for preview

Multiple image modes

  • • Close up mode

  • • Ultra close range mode

  • • Different image enhancement modes can be provided according to different organizations to improve image contrast, such as vascular enhancement and contour enhancement


FPGA+GPU Heterogeneous Architecture Platform - Endoscope Solution

ALINX is based on the heterogeneous design of AMD Zynq UltraScale+MPSoC+NVIDIA Jetson Orin NX, capable of real-time 8K video streaming, 3D, fluorescence, and supporting SDI/HDMI interfaces and AI intelligent assistance. The 8K image sensor captures image information, and the captured video stream is processed and transmitted by Zynq UltraScale+MPSoC FPGA for video image signal processing. NVIDIA Jetson Orin NX performs AI computation, detection, and analysis on received video images. The processed high-definition video images are presented on a high-definition monitor through a display interface for surgeons to view, with clear color and a delay of less than 50 milliseconds

2.jpg

FPGA+GPU heterogeneous architecture platform - surgical robot solution

The surgical robot system with Zynq UltraScale+MPSoC FPGA as the core technology can achieve real-time 3D, multiple imaging modes, left and right eye image time difference less than 100 microseconds, 8K video stream, loop display, 100G fiber optic network transmission, and AI intelligent assistance. Local doctor assistance, 8K image sensor captures image information, Zynq UltraScale+MPSoC FPGA module performs image processing, and then transmits it to NVIDIA Jetson Orin NX for encoding, merging, and forwarding. It is then transmitted to remote NVIDIA Jetson Orin NX through a 100G fiber optic interface for reception, decomposition, and decoding, and displayed on a remote high-definition monitor for remote surgeons to view and operate

03.jpg


FPGA+GPU heterogeneous architecture - video image processing development platform

Based on the heterogeneous design of AMD Zynq UltraScale+MPSoC+NVIDIA Jetson Orin NX, it meets the requirements of high-speed data transmission, AI edge computing, professional high-definition 8K video image acquisition and processing, rich 12G-SDI, DP, HDMI video interfaces, 100G optical fiber interfaces, and is suitable for industrial and manufacturing, medical endoscopy and surgical robots, robot development, smart city, security and other fields of solutions

  • • XCZ19EG

    FPGA Chip

  • •Jetson Orin NX

    GPU

  • •70T/100T

    AI computility

  • •12G-SDI

    8-channel bidirectional interface

  • • 8K high definition

    HDMI 2.1 Input/Output

  • •100G

    2-channel fiber optic interface

  • •1143K

    Logic Cells

  • •16GB | 8GB

    PS DDR4 | PL DDR4



Z19-M-6.jpg



Zynq UltraScale+ MPSoC system

FPGA

Device:XCZU19EG-2FFVC1760I,packaged: FFVC1760
Logic Cells:1,143K,Flip-Flops1,045K,LUTs523K,Block RAM34.6Mb,DSP Slices1968,GTH16.3Gb/s x44

CPU

Application processing unit:4x ARM Cortex-A53, 1.3GHz;
Real time processing unit:Dual core Cortex™-R5, 533MHz

GPU

Mali™-400 MP2,Frequency up to 667MHz

Cache | Storage

PS 8GB DDR4,PL 16GB DDR4 | 32GB eMMC FLASH,128MB QSPI FLASH

12G SDI Interface

8-channel bidirectional 12G SDI interface, supporting SD/HD/3G/6G/12G SDI rates, supporting up to 4K/60 frames of video input or output

100G Fiber optic interface

2 QSFP100G fiber optic interfaces, with a total data rate of 100Gbps per channel

Other interfaces

1 expansion port for FMC HPC, connecting various FMC modules externally; Gigabit Ethernet, JTAG, Uart and other interfaces


NVIDIA Jetson Orin NX system

model

Jetson Orin NX 8GB (Optional selection)

Jetson Orin NX 16GB (Optional selection)

computility

70TOPS

100TOPS

CPU

6 cores NVIDIA Arm Cortex A78AE V8.2 64 bit CPU,2GHz

8 cores NVIDIA Arm Cortex A78AE V8.2 64 bit CPU,2GHz

GPU

1024 cores NVIDIA Ampere GPU with 32 Tensor Cores

1024 cores NVIDIA Ampere GPU with 32 Tensor Cores

Video Memory

8GB 128bit LPDDR5

16GB 128bit LPDDR5

video coding

1x 4K60 (H.265); 3x 4K30 (H.265 6x 1080p60 (H.265); 12x 1080p30 (H.265)

Video decoding

1x 8K30 (H.265); 2x 4K60 (H.265); 4x 4K30 (H.265); 9x 1080p60 (H.265); 18x 1080p30 (H.265)

DP display interface

1-channel Display Port output interface, used for displaying video images, supports up to 4K@30Hz or 1080P@60Hz Output

Other interfaces

NVMe M.2 SSD hard drive (self purchased) M.2 WIFI/BT、USB3.0、 Gigabit Ethernet and other interfaces



Functional interface

Z19-M-ALINX-AMD-Xilinx-Zynq-UltraScale+-MPSoC-XCZU19EG-NVIDIA-Jetson-Orin-NX-module-FPGA-+-GPU-Heterogeneous-Computing-AI-Video-Image-Processing-Development-Development-Board-&-Kit-I.jpg



Alinx Electronic Limited 沪ICP备13046728号