Skip to content

bug: RepairTemplateStrategy includes only yes/no for the failing LLM-as-a-Judge requirement in the repair request #1247

@akihikokuroda

Description

@akihikokuroda

After "The email should have a salutation" requirement validation failed, the following information is sent to the LLM by RepairTemplateStrategy. The repair information don't have information which requirement failed.

INFO: 📤 Request to LLM:
Write an email to Olivia using the notes following: Olivia helped the lab over the last few weeks by organizing intern events, advertising the speaker series, and handling issues with snack delivery..

Requirements:
  - The email should have a salutation
  - Use ONLY lowercase letters (no capital letters, no proper nouns capitalized)
  - Include a specific sign-off phrase: 'thank you for everything'


[⭐ THIS IS A REPAIR ATTEMPT - Model receives feedback from previous failure ⭐]
The following requirements failed before:
* no

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions