Skip to content

Commit

Permalink
[Minor] Fix test_cache.py CI test failure (vllm-project#2684)
Browse files Browse the repository at this point in the history
  • Loading branch information
pcmoritz authored and jimpang committed Feb 22, 2024
1 parent 7cb52ef commit c8c8ab6
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions tests/kernels/test_cache.py
Original file line number Diff line number Diff line change
Expand Up @@ -200,12 +200,12 @@ def test_swap_blocks(

# Create the KV caches on the first device.
src_key_caches, src_value_caches = kv_cache_factory(
num_blocks, block_size, 1, num_heads, head_size, dtype, seed,
num_blocks, block_size, 1, num_heads, head_size, dtype, None, seed,
src_device)

# Create the KV caches on the second device.
dist_key_caches, dist_value_caches = kv_cache_factory(
num_blocks, block_size, 1, num_heads, head_size, dtype, seed,
num_blocks, block_size, 1, num_heads, head_size, dtype, None, seed,
dst_device)

src_key_caches_clone = src_key_caches[0].clone()
Expand Down

0 comments on commit c8c8ab6

Please sign in to comment.