Training-aware Quantization - Basic
Category: callback.quantization
Version: 1.0.0
UUID: 48f17df15208d97b2057e9270e618b10b0565bc58294b43968b29bfb9800f4a2
Execution context: leip_af
Choice Priority: 380.0
Value Parameters
| Name |
Synonyms |
Type |
Values |
| Quantization Policy |
quantization.aware_training.policy |
choice |
u:A4-BN4 (All 4 bit)
u:A[512-4,2048-2,inf-1]-BN4 (Hybrid 4b/2/1 bit - aggressive)
u:A[2048-4,8192-2,inf-1]-BN4 (Hybrid 4b/2/1 bit - medium)
u:A[8192-4,32768-2,inf-1]-BN4 (Hybrid 4b/2/1 bit - conservative)
u:A[512-4,inf-2]-BN4 (Hybrid 4/2 bit - aggressive)
u:A[8192-4,inf-2]-BN4 (Hybrid 4/2 bit - conservative)
u:A2-BN4 (All 2 bit, batch norm 4b) |
This component fits into