We should create a full set of automated tests for the OpenShift plugin that can be run with each CI build.