-
Notifications
You must be signed in to change notification settings - Fork 76
[LCORE-1393] chore: add agents.md and symlinked claude.md #1250
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Changes from all commits
Commits
File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,200 @@ | ||
| # Lightspeed Core Stack Development Guide | ||
|
|
||
| ## Project Overview | ||
| Lightspeed Core Stack (LCS) is an AI-powered assistant built on FastAPI that provides answers using LLM services, agents, and RAG databases. It integrates with Llama Stack for AI operations. | ||
|
|
||
| ## Development Environment | ||
| - **Python**: Check `pyproject.toml` for supported Python versions | ||
| - **Package Manager**: uv (use `uv run` for all commands) | ||
| - **Required Commands**: | ||
| - `uv run make format` - Format code (black + ruff) | ||
| - `uv run make verify` - Run all linters (black, pylint, pyright, ruff, docstyle, check-types) | ||
|
|
||
| ## Code Architecture & Patterns | ||
|
|
||
| ### Project Structure | ||
| ``` | ||
| src/ | ||
| ├── app/ # FastAPI application | ||
| │ ├── endpoints/ # REST API endpoints | ||
| │ └── main.py # Application entry point | ||
| ├── a2a_storage/ # A2A protocol persistent storage | ||
| │ ├── context_store.py # Abstract base class for context stores | ||
| │ ├── in_memory_context_store.py # In-memory implementation | ||
| │ ├── sqlite_context_store.py # SQLite implementation | ||
| │ ├── postgres_context_store.py # PostgreSQL implementation | ||
| │ └── storage_factory.py # Factory for creating stores | ||
| ├── authentication/ # Authentication modules (k8s, jwk, noop, rh-identity) | ||
| ├── authorization/ # Authorization middleware & resolvers | ||
| ├── cache/ # Conversation cache implementations | ||
| ├── quota/ # Quota limiter and token usage tracking | ||
| ├── metrics/ # Prometheus metrics | ||
| ├── runners/ # Agent runners | ||
| ├── models/ # Pydantic models | ||
| │ ├── config.py # Configuration classes | ||
| │ ├── requests.py # Request models | ||
| │ ├── responses.py # Response models | ||
| │ └── database/ # Database models | ||
| ├── utils/ # Utility functions | ||
| ├── client.py # Llama Stack client wrapper (Singleton) | ||
| ├── configuration.py # Config management (Singleton) | ||
| └── constants.py # Shared constants | ||
| ``` | ||
|
|
||
| ### Coding Standards | ||
|
|
||
| #### Imports & Dependencies | ||
| - Use absolute imports for internal modules: `from authentication import get_auth_dependency` | ||
| - FastAPI dependencies: `from fastapi import APIRouter, HTTPException, Request, status, Depends` | ||
| - Llama Stack imports: `from llama_stack_client import AsyncLlamaStackClient` | ||
| - **ALWAYS** check `pyproject.toml` for existing dependencies before adding new ones | ||
| - **ALWAYS** verify current library versions in `pyproject.toml` rather than assuming versions | ||
| - Check `constants.py` for shared constants before defining new ones | ||
|
|
||
| #### Module Standards | ||
| - All modules start with descriptive docstrings explaining purpose | ||
| - Use `logger = get_logger(__name__)` from `log.py` for module logging | ||
| - Package `__init__.py` files contain brief package descriptions | ||
| - Central `constants.py` for shared constants with descriptive comments | ||
| - Type aliases defined at module level for clarity | ||
|
|
||
| #### Configuration | ||
| - All config uses Pydantic models extending `ConfigurationBase` | ||
| - Base class sets `extra="forbid"` to reject unknown fields | ||
| - Use `@field_validator` and `@model_validator` for custom validation | ||
| - Type hints: `Optional[FilePath]`, `PositiveInt`, `SecretStr` | ||
|
|
||
| #### Function Standards | ||
| - **Documentation**: All functions require docstrings with brief descriptions | ||
| - **Type Annotations**: Complete type annotations for parameters and return types | ||
| - Use `typing_extensions.Self` for model validators | ||
| - Union types: `str | int` (modern syntax) | ||
| - Optional: `Optional[Type]` | ||
| - **Naming**: Use snake_case with descriptive, action-oriented names (get_, validate_, check_) | ||
| - **Return Values**: **CRITICAL** - Avoid in-place parameter modification anti-patterns: | ||
| ```python | ||
| # ❌ BAD: Modifying parameter in-place | ||
| def process_data(input_data: Any, result_dict: dict) -> None: | ||
| result_dict[key] = value # Anti-pattern | ||
|
|
||
| # ✅ GOOD: Return new data structure | ||
| def process_data(input_data: Any) -> dict: | ||
| result_dict = {} | ||
| result_dict[key] = value | ||
| return result_dict | ||
| ``` | ||
| - **Async Functions**: Use `async def` for I/O operations and external API calls | ||
| - **Error Handling**: | ||
| - Use FastAPI `HTTPException` with appropriate status codes for API endpoints | ||
| - Handle `APIConnectionError` from Llama Stack | ||
|
|
||
| #### Logging Standards | ||
| - Use `from log import get_logger` and module logger pattern: `logger = get_logger(__name__)` | ||
| - Standard log levels with clear purposes: | ||
| - `logger.debug()` - Detailed diagnostic information | ||
| - `logger.info()` - General information about program execution | ||
| - `logger.warning()` - Something unexpected happened or potential problems | ||
| - `logger.error()` - Serious problems that prevented function execution | ||
|
|
||
| #### Class Standards | ||
| - **Documentation**: All classes require descriptive docstrings explaining purpose | ||
| - **Naming**: Use PascalCase with descriptive names and standard suffixes: | ||
| - `Configuration` for config classes | ||
| - `Error`/`Exception` for custom exceptions | ||
| - `Resolver` for strategy pattern implementations | ||
| - `Interface` for abstract base classes | ||
| - **Pydantic Models**: Extend `ConfigurationBase` for config, `BaseModel` for data models | ||
| - **Abstract Classes**: Use ABC for interfaces with `@abstractmethod` decorators | ||
| - **Validation**: Use `@model_validator` and `@field_validator` for Pydantic models | ||
| - **Type Hints**: Complete type annotations for all class attributes | ||
|
|
||
| #### Docstring Standards | ||
| - Follow Google Python docstring conventions: https://google.github.io/styleguide/pyguide.html | ||
| - Required for all modules, classes, and functions | ||
| - Include brief description and detailed sections as needed: | ||
| - `Parameters:` for function parameters | ||
| - `Returns:` for return values | ||
| - `Raises:` for exceptions that may be raised | ||
| - `Attributes:` for class attributes (Pydantic models) | ||
|
|
||
|
|
||
| ## Testing Framework | ||
|
|
||
| ### Test Structure | ||
| ``` | ||
| tests/ | ||
| ├── unit/ # Unit tests (pytest) | ||
| ├── integration/ # Integration tests (pytest) | ||
| └── e2e/ # End-to-end tests (behave) | ||
| └── features/ # Gherkin feature files | ||
| ``` | ||
|
|
||
| ### Testing Framework Requirements | ||
| - **Required**: Use pytest for all unit and integration tests | ||
| - **Forbidden**: Do not use unittest - pytest is the standard for this project | ||
| - **E2E Tests**: Use behave (BDD) framework for end-to-end testing | ||
|
|
||
| ### Unit Tests (pytest) | ||
| - **Fixtures**: Use `conftest.py` for shared fixtures | ||
| - **Mocking**: `pytest-mock` for AsyncMock objects | ||
| - **Common Pattern**: | ||
| ```python | ||
| @pytest.fixture(name="prepare_agent_mocks") | ||
| def prepare_agent_mocks_fixture(mocker): | ||
| mock_client = mocker.AsyncMock() | ||
| mock_agent = mocker.AsyncMock() | ||
| mock_agent._agent_id = "test_agent_id" | ||
| return mock_client, mock_agent | ||
| ``` | ||
| - **Auth Mock**: `MOCK_AUTH = ("mock_user_id", "mock_username", False, "mock_token")` | ||
| - **Coverage**: Unit tests require 60% coverage, integration 10% | ||
|
|
||
| ### E2E Tests (behave) | ||
| - **Framework**: Behave (BDD) with Gherkin feature files | ||
| - **Step Definitions**: In `tests/e2e/features/steps/` | ||
| - **Common Steps**: Service status, authentication, HTTP requests | ||
| - **Test List**: Maintained in `tests/e2e/test_list.txt` | ||
|
|
||
| ### Test Commands | ||
| ```bash | ||
| uv run make test-unit # Unit tests with coverage | ||
| uv run make test-integration # Integration tests | ||
| uv run make test-e2e # End-to-end tests | ||
| ``` | ||
|
|
||
| ## Quality Assurance | ||
|
|
||
| ### Required Before Completion | ||
| 1. `uv run make format` - Auto-format code | ||
| 2. `uv run make verify` - Run all linters | ||
| 3. Create unit tests for new code | ||
| 4. Ensure tests pass | ||
|
|
||
| ### Linting Tools | ||
| - **black**: Code formatting | ||
| - **pylint**: Static analysis (`source-roots = "src"`) | ||
| - **pyright**: Type checking (excludes `src/authentication/k8s.py`) | ||
| - **ruff**: Fast linter | ||
| - **pydocstyle**: Docstring style | ||
| - **mypy**: Additional type checking | ||
|
|
||
| ### Security | ||
| - **bandit**: Security issue detection | ||
| - Never commit secrets/keys | ||
| - Use environment variables for sensitive data | ||
|
|
||
| ## Key Dependencies | ||
| **IMPORTANT**: Always check `pyproject.toml` for current versions rather than relying on this list: | ||
| - **FastAPI**: Web framework | ||
| - **Llama Stack**: AI integration | ||
| - **Pydantic**: Data validation/serialization | ||
| - **SQLAlchemy**: Database ORM | ||
| - **Kubernetes**: K8s auth integration | ||
|
|
||
| ## Development Workflow | ||
| 1. Use `uv sync --group dev --group llslibdev` for dependencies | ||
| 2. Always use `uv run` prefix for commands | ||
| 3. **ALWAYS** check `pyproject.toml` for existing dependencies and versions before adding new ones | ||
| 4. Follow existing code patterns in the module you're modifying | ||
| 5. Write unit tests covering new functionality | ||
| 6. Run format and verify before completion | ||
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
🧩 Analysis chain
🏁 Script executed:
Repository: lightspeed-core/lightspeed-stack
Length of output: 1884
Align
make verifytool list in the Linting Tools section.Line 11 correctly lists the verify target tools (black, pylint, pyright, ruff, docstyle, check-types), but the Linting Tools section at lines 173-180 includes tools not part of verify (mypy) and omits check-types. Update lines 173-180 to match what verify actually runs, or clarify which tools are part of verify versus optional/additional type checking tools.
🤖 Prompt for AI Agents
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This is correct the tool section highlights the tool name itself.. mypy is the tool, check-types is the make target.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@asamal4, thank you for the clarification! You're absolutely right—I misunderstood the intent. The Linting Tools section correctly lists the actual tool names (mypy, pylint, pyright, ruff, black), whilecheck-typesis the make target that invokes mypy. My apologies for the confusion.✏️ Learnings added
🧠 Learnings used