Target Supportability Matrix
Host Supportability
For information on supported host hardware, i.e., the device being used to optimize and create the compiled artifact, please consult the Host Supportability Matrix in the LEIP Optimize docs.
LEIP Deploy currently supports the following targets, i.e., the devices that will run inference on the compiled artifact.
| Device | Architecture | Device Family | OS | NVIDIA Dependencies | Default Python Version |
|---|---|---|---|---|---|
| Raspberry Pi 4 | ARM | CPU | Debian 11 | N/A | 3.9.2 |
| AGX (Orin) | ARM | CUDA 11.4 | Ubuntu 20.04 | Jetpack 5.1.2 | 3.8.10 |
| AGX (Xavier) | ARM | CUDA 11.4 | Ubuntu 20.04 | Jetpack 5.1.2 | 3.8.10 |
| Desktop/Server | x86-64 | CPU | Ubuntu 20.04 | N/A | 3.8.10 |
| Desktop/Server | x86-64 | CUDA 11.8 | Ubuntu 20.04 | TensorRT 8.5, CuDNN 8, CuFFT 10 | 3.8.10 |
| Desktop/Server | x86-64 | CUDA 12.1 | Ubuntu 20.04 | TensorRT 8.6, CuDNN 8, CuFFT 11 | 3.8.10 |
| Desktop/Server | x86-64 | CUDA 12.1 | Ubuntu 22.x | TensorRT 8.6, CuDNN 8, CuFFT 11 | 3.10.6 |
We will continue to expand our hardware support in the future and can build packages and runtimes to meet your needs. If your target hardware is not listed in the above table, please don't hesitate to contact us at support@latentai.com.