TensorRT Compiler

Category: compiler
Version: 1.0.1
UUID: 1239acabc7c8603d868839a5a916cb1f6bc9b0dde2509b9ba45d4d875c3da11a
Execution context: leip_forge
Choice Priority: 0.9

Subcomponent Parameters

Name	Synonyms	Allowable Categories
Quantizer	quantizer	quantizer.none,quantizer.trt

Value Parameters

Name	Synonyms	Type	Values	Help
Export Metadata	compiler.export_metadata	scalar	bool
Export Relay	compiler.export_relay	scalar	bool
Force Overwrite	compiler.force_overwrite	scalar	bool
Targeted Host	compiler.host	choice	15 choices
Optimization level	compiler.opt_level	scalar	int, min: 0, max: 4	An optimization flag leveraged by the compiler, where the highest level of 4 corresponds to the most aggressive optimizations.
Output folder	compiler.output_path	scalar	string	A directory to write the compiled artifact to
Channel Layout	compiler.set_channel_layout	choice	first last None
Enable Float16 Data Type	compiler.set_float16	scalar	bool
Targeted Hardware	compiler.target	choice	244 choices

This component fits into

Name	UUID	Synonyms
Full Recipe	9e361c...	compiler

Extra options

Targeted Host

llvm
apple/m1-gpu
apple/m1-gpu-restricted
apple/m2-gpu
aws/cpu/c5.12xlarge
aws/cpu/c5.18xlarge
aws/cpu/c5.24xlarge
aws/cpu/c5.2xlarge
aws/cpu/c5.4xlarge
aws/cpu/c5.9xlarge
aws/cpu/c5.large
aws/cpu/c5.xlarge
intel/cascadelake
intel/tigerlake
intel/skylake

Targeted Hardware

cuda
nvidia/geforce-410m
nvidia/geforce-610m
nvidia/geforce-705m
nvidia/geforce-710m
nvidia/geforce-800m
nvidia/geforce-820m
nvidia/geforce-830m
nvidia/geforce-840m
nvidia/geforce-910m
nvidia/geforce-920m
nvidia/geforce-930m
nvidia/geforce-940m
nvidia/geforce-gt-415m
nvidia/geforce-gt-420m
nvidia/geforce-gt-430
nvidia/geforce-gt-435m
nvidia/geforce-gt-440
nvidia/geforce-gt-445m
nvidia/geforce-gt-520
nvidia/geforce-gt-520m
nvidia/geforce-gt-520mx
nvidia/geforce-gt-525m
nvidia/geforce-gt-540m
nvidia/geforce-gt-550m
nvidia/geforce-gt-555m
nvidia/geforce-gt-610
nvidia/geforce-gt-620
nvidia/geforce-gt-620m
nvidia/geforce-gt-625m
nvidia/geforce-gt-630
nvidia/geforce-gt-630m
nvidia/geforce-gt-635m
nvidia/geforce-gt-640-gddr3
nvidia/geforce-gt-640-gddr5
nvidia/geforce-gt-640m
nvidia/geforce-gt-640m-le
nvidia/geforce-gt-645m
nvidia/geforce-gt-650m
nvidia/geforce-gt-705
nvidia/geforce-gt-720
nvidia/geforce-gt-720m
nvidia/geforce-gt-730
nvidia/geforce-gt-730-ddr3,128bit
nvidia/geforce-gt-730m
nvidia/geforce-gt-735m
nvidia/geforce-gt-740
nvidia/geforce-gt-740m
nvidia/geforce-gt-745m
nvidia/geforce-gt-750m
nvidia/geforce-gt-755m
nvidia/geforce-gts-450
nvidia/geforce-gtx-1050
nvidia/geforce-gtx-1060
nvidia/geforce-gtx-1070
nvidia/geforce-gtx-1070-ti
nvidia/geforce-gtx-1080
nvidia/geforce-gtx-1080-ti
nvidia/geforce-gtx-460
nvidia/geforce-gtx-460m
nvidia/geforce-gtx-465
nvidia/geforce-gtx-470
nvidia/geforce-gtx-470m
nvidia/geforce-gtx-480
nvidia/geforce-gtx-480m
nvidia/geforce-gtx-485m
nvidia/geforce-gtx-550-ti
nvidia/geforce-gtx-560-ti
nvidia/geforce-gtx-560m
nvidia/geforce-gtx-570
nvidia/geforce-gtx-570m
nvidia/geforce-gtx-580
nvidia/geforce-gtx-580m
nvidia/geforce-gtx-590
nvidia/geforce-gtx-650
nvidia/geforce-gtx-650-ti
nvidia/geforce-gtx-650-ti-boost
nvidia/geforce-gtx-660
nvidia/geforce-gtx-660-ti
nvidia/geforce-gtx-660m
nvidia/geforce-gtx-670
nvidia/geforce-gtx-670m
nvidia/geforce-gtx-670mx
nvidia/geforce-gtx-675m
nvidia/geforce-gtx-675mx
nvidia/geforce-gtx-680
nvidia/geforce-gtx-680m
nvidia/geforce-gtx-680mx
nvidia/geforce-gtx-690
nvidia/geforce-gtx-750
nvidia/geforce-gtx-750-ti
nvidia/geforce-gtx-760
nvidia/geforce-gtx-760m
nvidia/geforce-gtx-765m
nvidia/geforce-gtx-770
nvidia/geforce-gtx-770m
nvidia/geforce-gtx-780
nvidia/geforce-gtx-780-ti
nvidia/geforce-gtx-780m
nvidia/geforce-gtx-850m
nvidia/geforce-gtx-860m-sm-30
nvidia/geforce-gtx-860m-sm-50
nvidia/geforce-gtx-870m
nvidia/geforce-gtx-880m
nvidia/geforce-gtx-950
nvidia/geforce-gtx-950m
nvidia/geforce-gtx-960
nvidia/geforce-gtx-960m
nvidia/geforce-gtx-965m
nvidia/geforce-gtx-970
nvidia/geforce-gtx-970m
nvidia/geforce-gtx-980
nvidia/geforce-gtx-980-ti
nvidia/geforce-gtx-980m
nvidia/geforce-gtx-titan
nvidia/geforce-gtx-titan-black
nvidia/geforce-gtx-titan-x
nvidia/geforce-gtx-titan-z
nvidia/geforce-rtx-2060
nvidia/geforce-rtx-2070
nvidia/geforce-rtx-2080
nvidia/geforce-rtx-2080-ti
nvidia/geforce-rtx-3060
nvidia/geforce-rtx-3070
nvidia/geforce-rtx-3070-ti
nvidia/geforce-rtx-3080
nvidia/geforce-rtx-3080-ti
nvidia/geforce-rtx-3090
nvidia/geforce-rtx-3090-ti
nvidia/geforce-rtx-4090
nvidia/gtx1080ti
nvidia/jetson-agx-xavier
nvidia/jetson-nano
nvidia/jetson-orin-nano
nvidia/jetson-orin-nx-16gb
nvidia/jetson-orin-nx-8gb
nvidia/jetson-tx1
nvidia/jetson-tx2
nvidia/nvidia-a10
nvidia/nvidia-a100
nvidia/nvidia-a10g
nvidia/nvidia-a16
nvidia/nvidia-a2
nvidia/nvidia-a30
nvidia/nvidia-a40
nvidia/nvidia-nvs-310
nvidia/nvidia-nvs-315
nvidia/nvidia-nvs-510
nvidia/nvidia-nvs-810
nvidia/nvidia-t4
nvidia/nvidia-titan-rtx
nvidia/nvidia-titan-v
nvidia/nvidia-titan-x
nvidia/nvidia-titan-xp
nvidia/nvidia-v100
nvidia/nvs-4200m
nvidia/nvs-5200m
nvidia/nvs-5400m
nvidia/p520
nvidia/p620
nvidia/quadro-410
nvidia/quadro-gp100
nvidia/quadro-gv100
nvidia/quadro-k1100m
nvidia/quadro-k1200
nvidia/quadro-k2000
nvidia/quadro-k2000d
nvidia/quadro-k2100m
nvidia/quadro-k2200
nvidia/quadro-k2200m
nvidia/quadro-k3100m
nvidia/quadro-k4000
nvidia/quadro-k4100m
nvidia/quadro-k420
nvidia/quadro-k4200
nvidia/quadro-k4200m
nvidia/quadro-k5000
nvidia/quadro-k500m
nvidia/quadro-k5100m
nvidia/quadro-k510m
nvidia/quadro-k5200
nvidia/quadro-k5200m
nvidia/quadro-k600
nvidia/quadro-k6000
nvidia/quadro-k6000m
nvidia/quadro-k610m
nvidia/quadro-k620
nvidia/quadro-k620m
nvidia/quadro-m1000m
nvidia/quadro-m1200
nvidia/quadro-m2000
nvidia/quadro-m2000m
nvidia/quadro-m2200
nvidia/quadro-m3000m
nvidia/quadro-m4000
nvidia/quadro-m4000m
nvidia/quadro-m5000
nvidia/quadro-m5000m
nvidia/quadro-m500m
nvidia/quadro-m520
nvidia/quadro-m5500m
nvidia/quadro-m6000
nvidia/quadro-m6000-24gb
nvidia/quadro-m600m
nvidia/quadro-m620
nvidia/quadro-p1000
nvidia/quadro-p2000
nvidia/quadro-p2200
nvidia/quadro-p3000
nvidia/quadro-p3200
nvidia/quadro-p400
nvidia/quadro-p4000
nvidia/quadro-p4200
nvidia/quadro-p500
nvidia/quadro-p5000
nvidia/quadro-p5200
nvidia/quadro-p600
nvidia/quadro-p6000
nvidia/quadro-p620
nvidia/quadro-plex-7000
nvidia/quadro-rtx-4000
nvidia/quadro-rtx-5000
nvidia/quadro-rtx-6000
nvidia/quadro-rtx-8000
nvidia/rtx-3000
nvidia/rtx-4000
nvidia/rtx-5000
nvidia/rtx-a4500
nvidia/rtx-a6000
nvidia/t1000
nvidia/t2000
nvidia/tegra-x1
nvidia/tesla-c2050
nvidia/tesla-c2070
nvidia/tesla-c2075
nvidia/tesla-k10
nvidia/tesla-k20
nvidia/tesla-k40
nvidia/tesla-k80
nvidia/tesla-m40
nvidia/tesla-m60
nvidia/tesla-p100
nvidia/tesla-p4
nvidia/tesla-p40