Disabling by default possible?

I'd really like to be able to have no image rendering by default, but only enable it on-demand. If I set up the plugin regularly and then disable it, it will still load images from the initial buffer, slowing down the opening a lot for larger images. 
So it'd be nice if there could be an `enable_by_default` option to address this.