Serverless functions are becoming more powerful, and AWS Lambda now supports using up to 6 vCPUs per function. We could benefit by running multiple "workers" as threads on a single function and letting them communicate locally. We cannot use processes within a single function as that would require shmem, which is not supported on AWS Lambda.
This might require making collectives to be natively multi-protocol first #6.
Serverless functions are becoming more powerful, and AWS Lambda now supports using up to 6 vCPUs per function. We could benefit by running multiple "workers" as threads on a single function and letting them communicate locally. We cannot use processes within a single function as that would require shmem, which is not supported on AWS Lambda.
This might require making collectives to be natively multi-protocol first #6.