I have been working with geo data, which are typically large files, but can be split to process concurrently. I split the data into hundreds of files and added the processors for each file into a pool. When I executed, my CPU died.
It would be really useful to configure the max concurrent processes within a pool.
I have been working with geo data, which are typically large files, but can be split to process concurrently. I split the data into hundreds of files and added the processors for each file into a pool. When I executed, my CPU died.
It would be really useful to configure the max concurrent processes within a pool.