Skip to content

helper function#290

Merged
shreymodi1 merged 2 commits intomainfrom
shrey/swebenchhelperfunction
Oct 24, 2025
Merged

helper function#290
shreymodi1 merged 2 commits intomainfrom
shrey/swebenchhelperfunction

Conversation

@shreymodi1
Copy link
Copy Markdown
Contributor

@shreymodi1 shreymodi1 commented Oct 24, 2025

A small helper function to create evaluation rows using only row indices. Helpful to kick-off swebench


Note

Add helper to generate EvaluationRow objects by index with sequential row_id in input_metadata.

  • Utils (eval_protocol/utils/evaluation_row_utils.py):
    • Add create_rows_from_indices(count, **metadata) to generate EvaluationRow instances with sequential input_metadata.row_id values ("0"..).
    • Import InputMetadata to construct input_metadata for created rows.

Written by Cursor Bugbot for commit 9f7f0a1. This will update automatically on new commits. Configure here.

cursor[bot]

This comment was marked as outdated.

@shreymodi1 shreymodi1 merged commit d719f1c into main Oct 24, 2025
9 checks passed
@shreymodi1 shreymodi1 deleted the shrey/swebenchhelperfunction branch October 24, 2025 23:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants