- On 1 GPU, limited to 10 convolutional layers - When parallelized across multiple GPUs, can add more layers as more memory available