Training-aware Quantization - Basic
Category: callback.quantization
Version: 1.0.0
UUID: 8f64b87e5e3d480897e4d2ca907d172641312b34c8a78a567e86ab8e6f6dca27
Execution context: leip_af
Choice Priority: 380.0
Value Parameters
| Name |
Synonyms |
Type |
Values |
| Quantization Policy |
quantization.aware_training.policy |
choice |
u:A4-BN4 (All 4 bit)
u:A[512-4,2048-2,inf-1]-BN4 (Hybrid 4b/2/1 bit - aggressive)
u:A[2048-4,8192-2,inf-1]-BN4 (Hybrid 4b/2/1 bit - medium)
u:A[8192-4,32768-2,inf-1]-BN4 (Hybrid 4b/2/1 bit - conservative)
u:A[512-4,inf-2]-BN4 (Hybrid 4/2 bit - aggressive)
u:A[8192-4,inf-2]-BN4 (Hybrid 4/2 bit - conservative)
u:A2-BN4 (All 2 bit, batch norm 4b) |
This component fits into