Skip to content

Conversation

@jkirk5
Copy link
Contributor

@jkirk5 jkirk5 commented Jan 15, 2026

Summary

A subset of unittests were updated to use unittest's subTest feature, which allows for multiple failures to occur within a test, which prevents a developer from needing to update a test one assert at a time while debugging.

This work was done with AI (Claude 4.5 opus), and was a test of automating simple but tedious updates across multiple files. Only some files were updated due to limits/cost on repeatedly running an expensive LLM model and limitations on how many files in a row an agentic query could get through before stalling.

Updates to the FLOPS validation test helper functions was done manually.

Related Issues

  • Resolves #

Backwards incompatibilities

None

New Dependencies

None

@xjjiang
Copy link
Contributor

xjjiang commented Jan 23, 2026

Can AI check variable initialization and add all doc strings that are missing in Aviary?

@jkirk5
Copy link
Contributor Author

jkirk5 commented Jan 23, 2026

Can AI check variable initialization and add all doc strings that are missing in Aviary?

I'm not sure what you mean by variable initialization in this case. AI could definitely write docstrings, but I don't trust it to correctly explain function arguments, so it would need to be heavily reviewed

@jkirk5 jkirk5 marked this pull request as ready for review January 23, 2026 22:32
@xjjiang
Copy link
Contributor

xjjiang commented Jan 23, 2026

Can AI check variable initialization and add all doc strings that are missing in Aviary?

I'm not sure what you mean by variable initialization in this case. AI could definitely write docstrings, but I don't trust it to correctly explain function arguments, so it would need to be heavily reviewed

How about potential divide-by-zero errors and verbosity level?

@jkirk5 jkirk5 enabled auto-merge January 26, 2026 21:51


def flops_validation_test(
test: unittest.TestCase,
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

case_name should probably be removed from here too, since it is not longer used due to the change in arguments in do_validation_test.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants