PDLight (See the paper in arXiv) is a deep reinforcement learning agent for multi-intersection traffic signal control with PRCOL as the reward.
The proposed PRCOL considers not only the number of vehicles on the incoming lane but also the remaining capacity of the outgoing lane. It shares the similar code structure with CoLight.