Add the ability to cache failures

[BenB196]

In extremely high frequency situations caching failures is useful so there isn't a lot of time spent looking them up each time.