fix memory increase

[cangfengzhs]

What type of PR is this?

• bug
• feature
• enhancement

What problem(s) does this PR solve?

Issue(s) number:
cherry pick #3666

Description:

How do you solve it?

Special notes for your reviewer, ex. impact of this fix, design document, etc:

Checklist:

Tests:

• Unit test(positive and negative cases)
• Function test
• Performance test
• N/A

Affects:

• Documentation affected (Please add the label if documentation needs to be modified.)
• Incompatibility (If it breaks the compatibility, please describe it and add the label.）
• If it's needed to cherry-pick (If cherry-pick to some branches is required, please label the destination version(s).)
• Performance impacted: Consumes more CPU/Memory

Release notes:

Please confirm whether to be reflected in release notes and how to describe:

ex. Fixed the bug .....

[codecov-commenter]

Codecov Report

❗ No coverage uploaded for pull request base (v2.6.2@e80c45a). Click here to learn what that means.
The diff coverage is n/a.

@@            Coverage Diff            @@
##             v2.6.2    #3806   +/-   ##
=========================================
  Coverage          ?   85.25%           
=========================================
  Files             ?     1294           
  Lines             ?   116454           
  Branches          ?        0           
=========================================
  Hits              ?    99282           
  Misses            ?    17172           
  Partials          ?        0           

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update e80c45a...0aad12a. Read the comment docs.