Ablation Study on PatchSize

[yanjun711]

Hi, thanks for your graet open-source research.

Have you conducted any ablation studies on patch size to determine its effect? Could you provide more details about this?

[Shuangfei]

Hi — generally speaking, with the same model width and depth, performance increases as patch size decreases, and of course compute increases as well.