Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

refactor(LLM config): Restructure LLM configuration and management #276

Open
wants to merge 3 commits into
base: main
Choose a base branch
from

Commits on Nov 20, 2024

  1. refactor(LLM config): Restructure LLM configuration and management

    WHAT:
    - Support customizable LLM selection for each processing stage
    - Optimize model selection based on task requirements
    
    WHY:
    - Enable cost optimization by using appropriate models for different tasks
    - Improve translation quality with high-end models where needed
    
    DETAILS:
    - Recommend high-quality models (e.g. claude-3-5-sonnet) for translation tasks
    - Suggest cost-effective models (e.g. Yi-Lightning) with JSON output support for simple operations
    - Refactor config structure to support per-stage LLM configuration
    - Update core modules to respect stage-specific LLM settings
    
    AFFECTED:
    - config.yaml: Add per-stage LLM configuration
    - core/: Update LLM handling in processing modules
    - st_components/: Update UI for LLM selection
    
    Breaking Changes:
    - Configuration file structure updated for LLM settings
    - LLM initialization process modified
    mthezi committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    a931454 View commit details
    Browse the repository at this point in the history
  2. fix(i18n): dup key error

    mthezi authored Nov 20, 2024
    Configuration menu
    Copy the full SHA
    cb29ab3 View commit details
    Browse the repository at this point in the history

Commits on Nov 21, 2024

  1. Configuration menu
    Copy the full SHA
    32e5fc0 View commit details
    Browse the repository at this point in the history