Skip to content

Commit

Permalink
Allow saving on CPU usage for infrequent inference requests by reduci…
Browse files Browse the repository at this point in the history 
…ng thread spinning (#11841)

Introduce Start/Stop threadpool spinning switch
Add a session config option to force spinning stop at the end of the Run()
  • Loading branch information
@yuslepukhin @RandySheriffH
yuslepukhin authored and RandySheriffH committed Jun 29, 2022
1 parent 4092c54 commit 6414bc9
Show file tree
Hide file tree
Showing 6 changed files with 654 additions and 569 deletions.
Loading

0 comments on commit 6414bc9

Please sign in to comment.