Skip to content

Commit 05e2ffb

Browse files
committed
update eval for newsroom
1 parent e8ea045 commit 05e2ffb

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

human/newsroom/test_eval.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -193,7 +193,7 @@ def get_correlation_two_metrics(scores, metric_newsroom, metric_other, concensus
193193

194194
mean_score_vector_newsroom.append(mean(vector_newsroom))
195195
mean_score_vector_other .append(mean(vector_other))
196-
return eval(f"scipy.stats.{correlation_type}(vector_newsroom, vector_other)")[0]
196+
return eval(f"scipy.stats.{correlation_type}(mean_score_vector_newsroom, mean_score_vector_other)")[0]
197197

198198
# now begins the system-level judge
199199
correlations = {}

0 commit comments

Comments
 (0)