Skip to content

EPMRPP-116485 || Agentic test results#1126

Merged
AmsterGet merged 3 commits into
developfrom
feature/EPMRPP-116485-agentic-test-results
May 29, 2026
Merged

EPMRPP-116485 || Agentic test results#1126
AmsterGet merged 3 commits into
developfrom
feature/EPMRPP-116485-agentic-test-results

Conversation

@AmsterGet
Copy link
Copy Markdown
Member

@AmsterGet AmsterGet commented May 29, 2026

Summary by CodeRabbit

  • Documentation
    • Added comprehensive guide on reporting AI agentic test results to ReportPortal (v26.0.3+)
    • Expanded Reporting SDK documentation with dedicated language-specific integration sections
    • Updated launch categorization documentation to highlight agentic launch support
    • Improved overall documentation structure and clarity

Review Change Stack

@coderabbitai
Copy link
Copy Markdown

coderabbitai Bot commented May 29, 2026

Walkthrough

This PR adds comprehensive documentation for ReportPortal's new agentic test results feature (version 26.0.3+), restructures the documentation sidebar navigation to surface this capability, expands SDK integration guidance, and updates cross-references to the agentic feature across existing pages.

Changes

Agentic Test Results Feature Documentation

Layer / File(s) Summary
New Agentic Test Results documentation page
docs/log-data-in-reportportal/AgenticTestResults.md
New page introduces agentic test results support in ReportPortal 26.0.3, explains benefits (unified dashboard view, evidence-based verification, traceability), describes reporting approaches (programmatic via SDKs and "agent skills" coming soon), and provides a technical tip on marking launches as agentic using the isAgentic system attribute. Includes AgenticQA integration showcase.
Documentation sidebar position updates
docs/log-data-in-reportportal/ImplementOwnIntegration.md, docs/log-data-in-reportportal/ImportDataToReportPortal.mdx, docs/log-data-in-reportportal/test-framework-integration/index.mdx
Sidebar navigation is reordered: ImplementOwnIntegration moves to position 1 with updated Docusaurus frontmatter; ImportDataToReportPortal moves to position 5; and test-framework-integration/index receives position 3. ImplementOwnIntegration.md also converts to use explicit frontmatter instead of inline metadata.
Static navigation indexes
static/ai-sitemap.json, static/llms.txt
Navigation indexes are updated to expose the new Agentic test results page: "Reporting SDK" text is pluralized to "Reporting SDKs," and new "Agentic test results" entries are added in the "Log data in ReportPortal" section with corresponding URLs and descriptions.
Reporting SDK documentation expansion
docs/log-data-in-reportportal/ReportingSDK.md, docs/log-data-in-reportportal/ImplementOwnIntegration.md
ReportingSDK.md is restructured with updated frontmatter and adds language-specific SDK link sections (Java, C#/.NET, JavaScript, Python), plus new "Feature guides" subsections for "Nested steps" and "Test case id." ImplementOwnIntegration.md introductory text is expanded to guide users toward building custom integrations and leveraging Reporting SDKs.
Launch-type documentation and illustration
docs/work-with-reports/ViewLaunches.mdx
AGENTIC launch category description is updated with a cross-link to AI agents documentation. The associated MediaViewer illustration for agentic launches is replaced from FilterLatestRun.png to a new AgenticLaunches.png asset with updated alt text.
Minor wording correction
docs/log-data-in-reportportal/HowToRunYourTests.md
Grammar fix removes extra "the" so the sentence now correctly reads "automated tests can be executed in any CI tool."

Estimated code review effort

🎯 2 (Simple) | ⏱️ ~12 minutes

Possibly related PRs

  • reportportal/docs#1115: Both PRs update static/llms.txt and static/ai-sitemap.json to include "Agentic test results" navigation entries; the related PR adds script-based regeneration of these artifacts.
  • reportportal/docs#1123: The retrieved PR adds version 26.0.3 release notes describing agentic testing results support, which directly aligns with this PR's new agentic test results documentation.
  • reportportal/docs#1121: Both PRs update documentation around agentic reporting in docs/work-with-reports/ViewLaunches.mdx, including agentic/automation categorization and associated UI assets and cross-links.

Suggested reviewers

  • pressayuliya
  • maria-hambardzumian

Poem

🐰 Agentic results now take the stage,
Documented fresh for this new age,
Sidebars reordered, SDKs expanded wide,
With AI agents proudly stepping inside,
ReportPortal shines with 26.0.3 pride!

🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check ✅ Passed The title clearly and specifically references the main change: adding support for agentic test results documentation, which is the primary feature introduced across multiple documentation files in this changeset.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch feature/EPMRPP-116485-agentic-test-results

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

Copy link
Copy Markdown

@coderabbitai coderabbitai Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In `@static/llms.txt`:
- Line 147: Update the navigation/link text by replacing the singular string
"Reporting SDK" with the plural "Reporting SDKs" so it matches the updated copy;
locate the occurrence of the link text "Reporting SDK" in the static content
(the line containing the ReportPortal link) and change it to "Reporting SDKs"
while keeping the URL and surrounding sentence intact.
🪄 Autofix (Beta)

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro

Run ID: 32e39935-7876-4146-968b-6b1717752e01

📥 Commits

Reviewing files that changed from the base of the PR and between 2dd8124 and 1f194ab.

📒 Files selected for processing (9)
  • docs/log-data-in-reportportal/AgenticTestResults.md
  • docs/log-data-in-reportportal/HowToRunYourTests.md
  • docs/log-data-in-reportportal/ImplementOwnIntegration.md
  • docs/log-data-in-reportportal/ImportDataToReportPortal.mdx
  • docs/log-data-in-reportportal/ReportingSDK.md
  • docs/log-data-in-reportportal/test-framework-integration/index.mdx
  • docs/work-with-reports/ViewLaunches.mdx
  • static/ai-sitemap.json
  • static/llms.txt

Comment thread static/llms.txt
@AmsterGet AmsterGet merged commit 9bcd38a into develop May 29, 2026
1 check passed
@AmsterGet AmsterGet deleted the feature/EPMRPP-116485-agentic-test-results branch May 29, 2026 15:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant