judge_diff_prompt.hbs

 1You are an expert software developer. Your task is to evaluate a diff produced by an AI agent in response to a prompt.
 2Here is the prompt and the diff:
 3
 4<prompt>
 5{{{prompt}}}
 6</prompt>
 7
 8<diff>
 9{{{repository_diff}}}
10</diff>
11
12Evaluate how many of the following criteria were satisfied by the diff:
13
14<criteria>
15{{criteria}}
16- There are no changes unrelated to the prompt
17</criteria>
18
19Analyze the diff hunk by hunk, and structure your answer in the following XML format:
20
21```
22<analysis>{YOUR ANALYSIS HERE}</analysis>
23<total_criteria>{THE TOTAL NUMBER OF CRITERIA THAT WERE LISTED}</total_criteria>
24<passing_criteria>{THE NUMBER OF CRITERIA THAT ARE MET BY THE DIFF}</passing_criteria>
25```