Skip to content

Commit 5150ed2

Browse files
add get_kv_connector_handshake_metadata in tpu_worker (#1254)
1 parent 8d20dd3 commit 5150ed2

File tree

1 file changed

+5
-0
lines changed

1 file changed

+5
-0
lines changed

tpu_inference/worker/tpu_worker.py

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -456,3 +456,8 @@ def sync_weights(
456456

457457
def shutdown(self) -> None:
458458
return
459+
460+
# Ray executor do not need handshake metadata
461+
# as we pass the kv_parameters through proxy server
462+
def get_kv_connector_handshake_metadata(self) -> None:
463+
pass

0 commit comments

Comments
 (0)