[FR] Is it possible to assign a task to a random device instead of all devices based on the device's status?

[SaiZyca]

Right now, when I submit a task, all selected devices run it at the same time. For example, if I have four devices checked, I’ll get four separate results, even though I usually only need one. A better way would be to check each device’s queue through the API before sending the task, and then assign it to the device with the least workload. This makes the system much more efficient, especially in a multi-user environment.

[PNeelkanth16]

Yes, that will be a good option. I am also looking around for something like this only.

[robertvoy]

This has been added. Update custom nodes.

Add "Distributed Queue" to any workflow (don't add Distributed Collector). Now when you queue a workflow it will run on a free worker. To see the output you will need to look in the output folder (you need to use any save image/video node).

You can also achieve this using the API: https://github.com/robertvoy/ComfyUI-Distributed/blob/main/docs/comfyui-distributed-api.md

Feedback is welcome for this.

[SaiZyca]

Thanks for adding this feature! However, it feels a bit clunky to use at the moment. It’s also a pity that the output doesn't preview back on the original interface like the collect node does.

[robertvoy]

Let me know how you would image it working. I don't have a need for this, so I'm not sure about the use cases etc.