Target Supportability Matrix

Host Supportability

For information on supported host hardware, i.e., the device being used to optimize and create the compiled artifact, please consult the Host Supportability Matrix in the LEIP Optimize docs.

LEIP Deploy currently supports the following targets, i.e., the devices that will run inference on the compiled artifact.

Device	Architecture	Device Family	OS	NVIDIA Dependencies
Raspberry Pi 5 & 4	ARM	CPU	Debian 12	N/A
AGX (Orin)	ARM	CUDA 12.6	Ubuntu 22.04	Jetpack 6.2
AGX (Orin NX)	ARM	CUDA 12.6	Ubuntu 22.04	Jetpack 6.2
Desktop/Server	x86-64	CPU	Ubuntu 22.04 - 24.04	N/A
Desktop/Server	x86-64	CUDA 12.6 - 12.9	Ubuntu 22.04 - 24.04	TensorRT 10.X, CuDNN 9, CuFFT 11
Android	ARM	CPU	Android 8+	N/A

We will continue to expand our hardware support in the future and can build packages and runtimes to meet your needs. If your target hardware is not listed in the above table, please don't hesitate to contact us at support@latentai.com.