Skip to content

LCORE-1207: add guide for e2e tests#1234

Open
radofuchs wants to merge 1 commit intolightspeed-core:mainfrom
radofuchs:LCORE_1207_E2E_documentation
Open

LCORE-1207: add guide for e2e tests#1234
radofuchs wants to merge 1 commit intolightspeed-core:mainfrom
radofuchs:LCORE_1207_E2E_documentation

Conversation

@radofuchs
Copy link
Contributor

@radofuchs radofuchs commented Feb 27, 2026

Description

Add guide for E2E testing

Type of change

  • Refactor
  • New feature
  • Bug fix
  • CVE fix
  • Optimization
  • Documentation Update
  • Configuration Update
  • Bump-up service version
  • Bump-up dependent library
  • Bump-up library or tool used for development (does not change the final image)
  • CI configuration change
  • Konflux configuration change
  • Unit tests improvement
  • Integration tests improvement
  • End to end tests improvement
  • Benchmarks improvement

Tools used to create PR

Identify any AI code assistants used in this PR (for transparency and review context)

  • Assisted-by: (e.g., Claude, CodeRabbit, Ollama, etc., N/A if not used)
  • Generated by: (e.g., tool name and version; N/A if not used)

Related Tickets & Documents

  • Related Issue #LCORE-1207
  • Closes #LCORE-1207

Checklist before requesting a review

  • I have performed a self-review of my code.
  • PR has passed all pre-merge test jobs.
  • If it is a core feature, I have added thorough tests.

Testing

  • Please provide detailed steps to perform tests related to this code change.
  • How were the fix/results from this change verified? Please provide relevant screenshots or results.

Summary by CodeRabbit

  • Documentation
    • Added comprehensive End-to-End (E2E) testing guidance covering testing frameworks, execution environments, deployment modes, prerequisites, and troubleshooting steps.
    • Updated testing documentation with a reference to the new E2E testing guide.
    • Enhanced E2E tests README with improved structure and organization.

@radofuchs radofuchs requested a review from tisnik February 27, 2026 10:30
@coderabbitai
Copy link
Contributor

coderabbitai bot commented Feb 27, 2026

Walkthrough

New E2E testing documentation added to the Lightspeed Core Stack repository. A comprehensive guide (docs/e2e_testing.md) introduces End-to-End testing with Behave and Gherkin, covering setup, execution, deployment modes, configuration, and troubleshooting. The main testing documentation updated with a reference to the new guide, and the E2E tests README consolidated for clarity.

Changes

Cohort / File(s) Summary
E2E Testing Documentation
docs/e2e_testing.md, docs/testing.md, tests/e2e/README.md
Added comprehensive E2E testing guide covering framework (Behave/BDD/Gherkin), execution environments (Docker Compose, Prow/OpenShift), deployment modes, directory structure, prerequisites, run commands, environment variables, configuration, tagging, hooks, and troubleshooting. Updated main testing docs with reference to new guide and refreshed E2E README with consolidated structure.

Estimated code review effort

🎯 1 (Trivial) | ⏱️ ~5 minutes

Possibly related PRs

Suggested reviewers

  • tisnik
🚥 Pre-merge checks | ✅ 3
✅ Passed checks (3 passed)
Check name Status Explanation
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check ✅ Passed The title clearly and concisely summarizes the main change: adding a guide for end-to-end tests, which aligns with the documentation additions across multiple files.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Post copyable unit tests in a comment

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

Copy link
Contributor

@coderabbitai coderabbitai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 2

🤖 Prompt for all review comments with AI agents
Verify each finding against the current code and only fix it if needed.

Inline comments:
In `@docs/e2e_testing.md`:
- Line 36: Update the two markdown fenced code blocks in docs/e2e_testing.md
that currently use plain ``` fences (the blocks around the repo tree examples)
to include a language identifier (e.g., change ``` to ```text) so they pass
MD040; locate the two tree snippets and replace their opening fences with
```text for both occurrences.

In `@tests/e2e/README.md`:
- Line 9: Update the README entry that currently references "test_list.txt" to
use the repository-relative path "tests/e2e/test_list.txt" so the feature
run-order file reference is explicit and consistent; locate the line containing
the bullet "* Feature list (run order): `test_list.txt`" and replace the
filename token with the full path string.

ℹ️ Review info

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Pro

📥 Commits

Reviewing files that changed from the base of the PR and between 9a6024a and 3cf72df.

📒 Files selected for processing (3)
  • docs/e2e_testing.md
  • docs/testing.md
  • tests/e2e/README.md


**E2E tests (Behave, feature files, steps):**

```
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Potential issue | 🟡 Minor

Add language identifiers to fenced code blocks to satisfy markdown linting.

Both tree snippets currently trigger MD040.

🧹 Proposed lint fix
-```
+```text
 tests/e2e/
 ├── README.md                    # Short pointer to this guide (docs/e2e_testing.md)
 ...
 └── rag/                         # RAG test data (e.g. for FAISS)

@@
- +text
tests/e2e-prow/
└── rhoai/ # RHOAI / OpenShift E2E
...
└── gpu/ # NFD and cluster policy for GPU

Also applies to: 68-68

🧰 Tools
🪛 markdownlint-cli2 (0.21.0)

[warning] 36-36: Fenced code blocks should have a language specified

(MD040, fenced-code-language)

🤖 Prompt for AI Agents
Verify each finding against the current code and only fix it if needed.

In `@docs/e2e_testing.md` at line 36, Update the two markdown fenced code blocks
in docs/e2e_testing.md that currently use plain ``` fences (the blocks around
the repo tree examples) to include a language identifier (e.g., change ``` to
```text) so they pass MD040; locate the two tree snippets and replace their
opening fences with ```text for both occurrences.


* Tests: `tests/e2e/features/*.feature`
* Step definitions: `tests/e2e/features/steps/`
* Feature list (run order): `test_list.txt`
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Potential issue | 🟡 Minor

Use the full path for the feature run-order file.

test_list.txt works in-context, but using tests/e2e/test_list.txt here would be clearer and consistent with the rest of the docs.

✏️ Proposed documentation tweak
-* Feature list (run order): `test_list.txt`
+* Feature list (run order): `tests/e2e/test_list.txt`

Based on learnings, maintain test list in tests/e2e/test_list.txt for end-to-end tests.

📝 Committable suggestion

‼️ IMPORTANT
Carefully review the code before committing. Ensure that it accurately replaces the highlighted code, contains no missing lines, and has no issues with indentation. Thoroughly test & benchmark the code to ensure it meets the requirements.

Suggested change
* Feature list (run order): `test_list.txt`
* Feature list (run order): `tests/e2e/test_list.txt`
🤖 Prompt for AI Agents
Verify each finding against the current code and only fix it if needed.

In `@tests/e2e/README.md` at line 9, Update the README entry that currently
references "test_list.txt" to use the repository-relative path
"tests/e2e/test_list.txt" so the feature run-order file reference is explicit
and consistent; locate the line containing the bullet "* Feature list (run
order): `test_list.txt`" and replace the filename token with the full path
string.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant