You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: metrics/bleurt/README.md
+11-5Lines changed: 11 additions & 5 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -42,9 +42,15 @@ This metric takes as input lists of predicted sentences and reference sentences:
42
42
```
43
43
44
44
### Inputs
45
+
46
+
For the `load` function:
47
+
48
+
-**config_name** (`str`): BLEURT checkpoint. Will default to `"bleurt-base-128"` if not specified. Other models that can be chosen are: `"bleurt-tiny-128"`, `"bleurt-tiny-512"`, `"bleurt-base-128"`, `"bleurt-base-512"`, `"bleurt-large-128"`, `"bleurt-large-512"`, `"BLEURT-20-D3"`, `"BLEURT-20-D6"`, `"BLEURT-20-D12"` and `"BLEURT-20"`.
49
+
50
+
For the `compute` function:
51
+
45
52
-**predictions** (`list` of `str`s): List of generated sentences to score.
46
53
-**references** (`list` of `str`s): List of references to compare to.
47
-
-**checkpoint** (`str`): BLEURT checkpoint. Will default to `BLEURT-tiny` if not specified. Other models that can be chosen are: `"bleurt-tiny-128"`, `"bleurt-tiny-512"`, `"bleurt-base-128"`, `"bleurt-base-512"`, `"bleurt-large-128"`, `"bleurt-large-512"`, `"BLEURT-20-D3"`, `"BLEURT-20-D6"`, `"BLEURT-20-D12"` and `"BLEURT-20"`.
48
54
49
55
### Output Values
50
56
-**scores** : a `list` of scores, one per prediction.
@@ -65,7 +71,7 @@ BLEURT is used to compare models across different asks (e.g. (Table to text gene
65
71
66
72
### Examples
67
73
68
-
Example with the default model:
74
+
Example with the default model (`"bleurt-base-128"`):
0 commit comments