Commit 6244a9b
committed
feat: replace regex parsers with tree-sitter AST parsing
Replace all regex-based parsers (TypeScript, Python, Rust, Java) with
tree-sitter AST parsers using gotreesitter pure Go runtime. Add new
parsers for C#, Ruby, PHP, Kotlin, Swift, and C/C++.
- 10 language extractors with full import/export/type extraction
- Pure Go, no CGO -- cross-compiles to all platforms
- 205 embedded grammars via gotreesitter
- Delete old regex parsers (typescript.go, python.go, rust.go, java.go)
- All existing tests updated and passing1 parent cec513c commit 6244a9b
24 files changed
Lines changed: 2102 additions & 547 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
4 | 4 | | |
5 | 5 | | |
6 | 6 | | |
7 | | - | |
8 | | - | |
9 | 7 | | |
10 | 8 | | |
11 | 9 | | |
12 | 10 | | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
13 | 15 | | |
14 | | - | |
15 | | - | |
16 | | - | |
17 | | - | |
18 | | - | |
| 16 | + | |
19 | 17 | | |
20 | | - | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
21 | 21 | | |
22 | | - | |
| 22 | + | |
23 | 23 | | |
24 | | - | |
| 24 | + | |
| 25 | + | |
| 26 | + | |
| 27 | + | |
25 | 28 | | |
26 | 29 | | |
27 | | - | |
28 | | - | |
29 | | - | |
30 | 30 | | |
31 | 31 | | |
32 | 32 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
11 | 11 | | |
12 | 12 | | |
13 | 13 | | |
| 14 | + | |
14 | 15 | | |
15 | 16 | | |
16 | 17 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
11 | 11 | | |
12 | 12 | | |
13 | 13 | | |
| 14 | + | |
| 15 | + | |
14 | 16 | | |
15 | 17 | | |
16 | 18 | | |
| |||
This file was deleted.
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
5 | 5 | | |
6 | 6 | | |
7 | 7 | | |
8 | | - | |
9 | | - | |
10 | | - | |
11 | | - | |
12 | | - | |
13 | | - | |
14 | | - | |
15 | | - | |
16 | | - | |
17 | | - | |
18 | | - | |
19 | | - | |
20 | | - | |
21 | | - | |
22 | | - | |
23 | | - | |
24 | | - | |
25 | | - | |
26 | | - | |
27 | | - | |
28 | | - | |
29 | 8 | | |
30 | 9 | | |
31 | | - | |
| 10 | + | |
32 | 11 | | |
33 | 12 | | |
34 | 13 | | |
| |||
60 | 39 | | |
61 | 40 | | |
62 | 41 | | |
63 | | - | |
| 42 | + | |
64 | 43 | | |
65 | 44 | | |
66 | 45 | | |
| |||
88 | 67 | | |
89 | 68 | | |
90 | 69 | | |
91 | | - | |
| 70 | + | |
92 | 71 | | |
93 | 72 | | |
94 | 73 | | |
| |||
106 | 85 | | |
107 | 86 | | |
108 | 87 | | |
109 | | - | |
| 88 | + | |
110 | 89 | | |
111 | 90 | | |
112 | 91 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
30 | 30 | | |
31 | 31 | | |
32 | 32 | | |
33 | | - | |
34 | | - | |
35 | | - | |
36 | | - | |
| 33 | + | |
37 | 34 | | |
38 | 35 | | |
39 | 36 | | |
| |||
This file was deleted.
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
6 | 6 | | |
7 | 7 | | |
8 | 8 | | |
9 | | - | |
10 | | - | |
11 | | - | |
12 | | - | |
13 | | - | |
14 | | - | |
15 | | - | |
16 | | - | |
17 | | - | |
18 | | - | |
19 | | - | |
20 | | - | |
21 | | - | |
22 | | - | |
23 | | - | |
24 | | - | |
25 | | - | |
26 | | - | |
27 | | - | |
28 | | - | |
29 | | - | |
30 | | - | |
31 | 9 | | |
32 | 10 | | |
33 | | - | |
| 11 | + | |
34 | 12 | | |
35 | 13 | | |
36 | 14 | | |
| |||
62 | 40 | | |
63 | 41 | | |
64 | 42 | | |
65 | | - | |
| 43 | + | |
66 | 44 | | |
67 | 45 | | |
68 | 46 | | |
| |||
98 | 76 | | |
99 | 77 | | |
100 | 78 | | |
101 | | - | |
| 79 | + | |
102 | 80 | | |
103 | 81 | | |
104 | 82 | | |
| |||
116 | 94 | | |
117 | 95 | | |
118 | 96 | | |
119 | | - | |
| 97 | + | |
120 | 98 | | |
121 | 99 | | |
122 | 100 | | |
| |||
136 | 114 | | |
137 | 115 | | |
138 | 116 | | |
139 | | - | |
| 117 | + | |
140 | 118 | | |
141 | 119 | | |
142 | 120 | | |
| |||
0 commit comments