Commit 892edc6
committed
selfattention block: Remove the fc linear layer if it is not used
Signed-off-by: John Zielke <j.l.zielke@gmail.com>1 parent 8dcb9dc commit 892edc6
1 file changed
Lines changed: 5 additions & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
106 | 106 | | |
107 | 107 | | |
108 | 108 | | |
109 | | - | |
| 109 | + | |
| 110 | + | |
| 111 | + | |
| 112 | + | |
| 113 | + | |
110 | 114 | | |
111 | 115 | | |
112 | 116 | | |
| |||
0 commit comments