Bitscaling: Streamlining neural network compression via predictive multi-scale growth of mixed-precision networks.

Jointly optimizing model scale and quantization for neural networks achieves significantly higher compression ratios than either technique alone. However, the resulting combinatorial search space renders most existing methods impractical in real-worl…

Preview only. Read the full abstract at the source