Unable to handle sprite picking events through RenderTextures

[kfjustis]

Bevy version and features

• Forked from 0f6d574
• Modified the sprite_picking example so correct picking features should be enabled already.

Relevant system information

• Linux (wayland)
• NVIDIA GeForce RTX 2060 SUPER, driver 595.45.04
• Vulkan backend
• rustc 1.94.0, stable-x86_64-unknown-linux-gnu

What you did

Modified the sprite_picking example to render through a RenderTexture, just like the pixel_grid_snap example. A forked repo with minimal code changes can be found here: https://github.com/kfjustis/bevy/tree/sprite_picking_rendertarget

What went wrong

I expected the same mouse hover/click events to fire as the normal sprite_picking example, which should cause the sprites to change color. However, even with the SpritePickingMode set to BoundingBox, mouse input doesn't seem to affect the sprites.

Additional information

There is an older issue here related to sprite picking with multiple cameras, but I'm not sure if it's the same bug or not.

It's also possible I just set up the picking incorrectly, so if this is user error, feel free to close this issue.

To test, just build my forked branch and run:

cargo run --example sprite_picking

[alice-i-cecile]

You might want to look at how our existing ViewportNode functions; I remember us resolving similar problems there.

If nothing else we should have clear docs about how to get this working.

[kfjustis]

Thanks! I'll look into that.

[kfjustis]

Just verified in my game--separate codebase, same setup--if I switch the "OuterCamera" for a ViewportNode, the pointer events do get passed through properly! I didn't even need to use SpritePickingMode::BoundingBox.

So basically, I just needed to swap

commands.spawn((Camera2d, Msaa::Off, OuterCamera, HIGH_RES_LAYERS));

with

commands.spawn((
        Node {
            // desired position and size settings...
        },
        ViewportNode::new(game_camera),
    ));

and game_camera is the entity id for the "pixel camera" containing the RenderTarget.