Training-aware Quantization - Basic
Category: callback.quantization
Version: 1.0.0
UUID: c7f8112c1311ec5ea1181c3e3b4be90ccbd646afc325c9e9548f9d5dec75d687
Execution context: leip_af
Choice Priority: 380.0
Value Parameters
| Name |
Synonyms |
Type |
Values |
| Quantization Policy |
quantization.aware_training.policy |
choice |
u:A4-BN4 (All 4 bit)
u:A[512-4,2048-2,inf-1]-BN4 (Hybrid 4b/2/1 bit - aggressive)
u:A[2048-4,8192-2,inf-1]-BN4 (Hybrid 4b/2/1 bit - medium)
u:A[8192-4,32768-2,inf-1]-BN4 (Hybrid 4b/2/1 bit - conservative)
u:A[512-4,inf-2]-BN4 (Hybrid 4/2 bit - aggressive)
u:A[8192-4,inf-2]-BN4 (Hybrid 4/2 bit - conservative)
u:A2-BN4 (All 2 bit, batch norm 4b) |
This component fits into