Number of tokens allowed for clause sonnet is too low

[twidi]

What happened?

I added some files in the chat to use with claude 3.5 sonnet and I receive this message:

"The total number of tokens requested 53034 exceeds the maximum limit of 24576 for model claude-3.5-sonnet. Try breaking your request into smaller chunks or summarizing your input."

Sonnet allowing 200k tokens I'm not sure what is wrong or if it's a bug in CodeGPT

When searching online for "24576 tokens" it's seem to be related with llama but here I use Clade 3.5 Sonnet via my CodeGPT account

Relevant log output or stack trace

The total number of tokens requested 53034 exceeds the maximum limit of 24576 for model claude-3.5-sonnet. Try breaking your request into smaller chunks or summarizing your input.

Steps to reproduce

Add enough files in the chat so that the total number of tokens exceed this value

CodeGPT version

2.11.3-241.1

Operating System

Linux