When testing, Jeff Layton observed that latest kernel get installed on hosts, but hosts don't get rebooted afterwards by the ansible scripts.
In pre-config.yaml, I see all packages are updated using 'update_packages' section. Then we install a bunch of packages. Maybe installing them also somehow installs the latest kernel on the hosts?