Skip to content

Commit

Permalink
overwrite openai options
Browse files Browse the repository at this point in the history
  • Loading branch information
leondz committed Jun 19, 2024
1 parent 481717e commit c9aab98
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion garak/generators/nim.py
Original file line number Diff line number Diff line change
Expand Up @@ -33,7 +33,7 @@ class NVOpenAIChat(OpenAICompatible):
# per https://docs.nvidia.com/ai-enterprise/nim-llm/latest/openai-api.html
# 2024.05.02, `n>1` is not supported
ENV_VAR = "NIM_API_KEY"
DEFAULT_PARAMS = OpenAICompatible.DEFAULT_PARAMS | {
DEFAULT_PARAMS = {
"temperature": 0.1,
"top_p": 0.7,
"top_k": 0, # top_k is hard set to zero as of 24.04.30
Expand Down

0 comments on commit c9aab98

Please sign in to comment.