[Backport 2.x] Fix bug where quantization framework does not work with training

[Backport 2.x] Fix bug where quantization framework does not work with training #3078