[FEATURE] resnet padding_mode

[zmurez]

I would like to create a resnet model with padding_mode=='reflect' for all conv layers. This would be possible if we added a padding_mode kwarg throughout. I can submit a PR if this sounds reasonable?

[rwightman]

@zmurez I think changes like this could be better done with a helper fn that walks the model modules, kind of related to #1529 ... I'd rather explore feasbility of adding model manipulation helpers. Adding more kwargs for rarely used functionality increases maintenance burden and modelling code complexity (EDIT: not to mention, needs to add for every model that you want to support)

For this I think it'd be pretty easy to iterate over all modules and change the padding mode for all conv > 1x1.

Quick draft:

for n, m in mm.named_modules():
    if isinstance(m, torch.nn.Conv2d):
        if hasattr(m, 'padding_mode'):
            setattr(m, 'padding_mode', 'reflect')

[zmurez]

I like that solution. Thanks!