File Test Bug

1---2name: file-test-bug3description: "File a GitHub issue for local integration test failures. TRIGGERS: file test bug, report test failure, create bug for test, integration test failed, test failure issue, junit failure"4license: MIT5metadata:6  author: Microsoft7  version: "1.0.0"8---9 10# File Test Bug11 12Creates a GitHub issue in `microsoft/github-copilot-for-azure` for integration test failures.13 14## Input15 16- **Skill name** (required): e.g., `azure-rbac`, `appinsights-instrumentation`17- **Test run** (optional): Timestamp of test run. Defaults to most recent with logs for the skill.18 19## Steps20 211. Ask user for skill name if not provided222. Parse `tests/reports/junit.xml` for failures matching the skill233. Find test run directory (specified or most recent with matching logs)244. Read `agent-metadata.md` from `tests/reports/test-run-<timestamp>/<skillname>-<testname>/`255. For each failure, read the actual line of code from the test file using the location (file:line) from junit.xml266. **REQUIRED - Write diagnosis BEFORE creating issue:**27   - Analyze the agent-metadata.md to understand what the agent did28   - Compare agent behavior to what the test expected (from the assertion)29   - Identify the root cause (skill issue, test issue, or model behavior)30   - Write 2-3 sentences per failed test explaining WHY it failed31   - Suggest potential fixes (update skill, update test, or update fixtures)327. Create issue via `github-mcp-server-create_issue`:33 34```35owner: microsoft36repo: github-copilot-for-azure37title: Integration test failure in <skill-name>38labels: ["bug", "integration-test"]39body: |40  ## Failed Tests41  - <test-name>: <error message>42  43  ## Diagnosis44  45  ### Root Cause46  <1-2 sentences explaining WHY the test failed based on agent-metadata.md analysis>47  48  ### Analysis per Test49  - **<test-name>**: <what agent did vs what test expected>50  51  ### Suggested Fix52  <one of: update skill, update test assertions, provide test fixtures>53 54  ## Details55  ### <test-name>56  **Error:** <failure from junit.xml>57  **Location:** <file:line>58  ```typescript59  <actual line of code from the test file at the specified line number>60  ```61  62  <details>63  <summary>agent-metadata.md</summary>64  65  <full contents of agent-metadata.md file, verbatim>66  67  </details>68```69 70## Important71 72Include the **complete, unmodified contents** of each `agent-metadata.md` file in the issue body. Do NOT summarize or truncate the logs. Wrap each log in a `<details>` block with the test name as the summary.