Enhancement: Send "stream_options": {"include_usage": true}
when "stream": true
#4099
Open
1 task done
Labels
enhancement
New feature or request
What features would you like to see added?
When
"stream": true
, it'd be ideal if LibreChat could also send"stream_options": {"include_usage": true}
. This only applies to OpenAI API endpoints.More details
When running through a proxy, it's nice to get the token usage cached too.
Which components are impacted by your request?
General
Pictures
No response
Code of Conduct
The text was updated successfully, but these errors were encountered: