Skip to content

Commit

Permalink
[Minor] Fix err msg (vllm-project#2431)
Browse files Browse the repository at this point in the history
  • Loading branch information
WoosukKwon committed Jan 12, 2024
1 parent 218dc2c commit 35c4bc2
Showing 1 changed file with 3 additions and 3 deletions.
6 changes: 3 additions & 3 deletions vllm/worker/worker.py
Original file line number Diff line number Diff line change
Expand Up @@ -239,6 +239,6 @@ def _check_if_gpu_supports_dtype(torch_dtype: torch.dtype):
raise ValueError(
"Bfloat16 is only supported on GPUs with compute capability "
f"of at least 8.0. Your {gpu_name} GPU has compute capability "
f"{compute_capability[0]}.{compute_capability[1]}."
f" You can explicitly specify the data type by using the --dtype option, for example: --dtype=half."
)
f"{compute_capability[0]}.{compute_capability[1]}. "
"You can use float16 instead by explicitly setting the"
"`dtype` flag in CLI, for example: --dtype=half.")

0 comments on commit 35c4bc2

Please sign in to comment.