There's a config option black_screen_when_light_low that lets you turn the display off in low light.
However, my finger casts a shadow when pressing the buttons, fooling the sensor into thinking it's night time and disabling the buttons.
A timer or counter of some kind that disables the functionality and keeps the backlight/display on when you press a button for 10s regardless of how low the light might be a useful