Skip to content

Latest commit

 

History

History
10 lines (5 loc) · 924 Bytes

File metadata and controls

10 lines (5 loc) · 924 Bytes

Spark RPC

Major classes: RpcEnv, RpcEndpoint, RpcEndpointRef)

The RPC (remote procedure call) is used in Spark for remote communications. It’s goal is to replace Akka used in Spark. Thus, the design heavily inspired by Akka. (See SPARK-5124, Spark-5293). You can think of it as a lite version of Akka actor system.

neoReMinD extracted the Spark RPC(based on Spark 2.1) to a standalone project. This section demostrates what Spark RPC does and how to use it.

The author also write an article In Depth Analysis of Spark RPC in Chinese. It explained Spark RPC quite well and was endorsed by the main designer Shixiong Zhu.