Truncate observation spaces beyond walls

[vkopio]

To make the observations of the agents more realistic, the observations beyond walls could be truncated so that the agents couldn't see through walls.

Ideally, this would be a toggleable feature, for example in GDY.

[Bam4d]

OK, so be a bit more specific here... when you say "truncated" what do you mean. Th observations space would stay the same but then the "unseeable" elements would be what exactly?

I envisage in vector observations we can have add a category to the object-type one-hot that represents "not visible" or we could just make the whole cell zeros.

in Sprite2D and Block2D observations I imaging we just make those cells black?

[vkopio]

I do not have strong opinions about the implementation details. Just that the agent would not notice any changes in the observation space if something happened behind a wall. Having those parts zeros would be the most convenient in my case, though.

In the visual representation, those parts being black would be fine, or grey to differentiate it.