Training-aware Quantization - Basic
Category: callback.quantization
Version: 1.0.0
UUID: 7e92f2d9bc011024ddf5c80ba99bedfa7ba2a94224cec533362aec713459ed3c
Execution context: leip_af
Choice Priority: 380.0
Value Parameters
| Name |
Synonyms |
Type |
Values |
| Quantization Policy |
quantization.aware_training.policy |
choice |
u:A4-BN4 (All 4 bit)
u:A[512-4,2048-2,inf-1]-BN4 (Hybrid 4b/2/1 bit - aggressive)
u:A[2048-4,8192-2,inf-1]-BN4 (Hybrid 4b/2/1 bit - medium)
u:A[8192-4,32768-2,inf-1]-BN4 (Hybrid 4b/2/1 bit - conservative)
u:A[512-4,inf-2]-BN4 (Hybrid 4/2 bit - aggressive)
u:A[8192-4,inf-2]-BN4 (Hybrid 4/2 bit - conservative)
u:A2-BN4 (All 2 bit, batch norm 4b) |
This component fits into