Skip to content

Add results commands for analyzing failed tests - #51

Open
ndimer wants to merge 2 commits into
masterfrom
feature/results-commands
Open

ndimer wants to merge 2 commits into
masterfrom
feature/results-commands

Conversation

@ndimer

@ndimer ndimer commented Nov 12, 2026

Copy link
Copy Markdown
Contributor

Why

Lets a developer, or an AI agent working in a test automation project, find out why tests failed and get enough detail to fix the code, straight from the terminal.

Commands

Work with current servers (existing API-key endpoints):

  • results failures: recent failures, with result and iteration ids.
  • results last-failure <name> [--suite]: last failure of a case or suite, compared with the baseline.
  • results run <runId>: failure breakdown of a run.

Need cloudbeat-io/cb-new-arch#558 (otherwise the CLI prints a "needs a newer server" hint on 404):

  • results show <resultId>: failure breakdown by result id.
  • results iteration <id>: every step, log line, parameter and attachment of one iteration. --screenshots <dir> saves the failed steps' screenshots.
  • results history <case>: recent runs of a case and when it last passed.
  • results ai-data <resultId>: the compact failure digest used by "AI summarize".

Output is readable by default, and a single JSON document with --json.

Fixes

  • results run read the summary from the wrong level, so name, status and dates were empty.
  • The failure location no longer repeats the line number.

🤖 Generated with Claude Code

ndimer and others added 2 commits October 28, 2026 11:29
results failures, results last-failure <name> [--suite] and results run <runId>
use the existing API-key endpoints, so they work with current CloudBeat servers.
Output is readable by default and a single JSON document with --json.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
- results show <resultId>: failure breakdown by result id
- results iteration <id>: every step, log line, parameter and attachment of one
  iteration; --screenshots saves the failed steps' screenshots
- results history <case>: recent runs of a case and when it last passed
- results ai-data <resultId>: the compact failure digest used by "AI summarize"
- failures/run/show print result and iteration ids to drill down
- fix: results run read the summary from the wrong level, so name, status and
  dates were empty

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant