Skip to content

feat: support llm filter for rss watcher - #6

Merged
Gennadiyev merged 7 commits into
Gennadiyev:mainfrom
fanqiNO1:rss_filter
Jan 13, 2026
Merged

feat: support llm filter for rss watcher#6
Gennadiyev merged 7 commits into
Gennadiyev:mainfrom
fanqiNO1:rss_filter

Conversation

@fanqiNO1

Copy link
Copy Markdown
Contributor

No description provided.

@Gennadiyev Gennadiyev left a comment

Copy link
Copy Markdown
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If I were you I would use response_format throughout... But yours have compatability so that's a reasonable trade-off.

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR adds LLM-based filtering capability to the RSS watcher, allowing users to automatically filter RSS feed entries based on relevance before processing them for digests or notifications. This helps reduce noise from high-volume feeds by only showing entries deemed relevant by an LLM.

Changes:

  • Added LLM filter configuration options with customizable prompts, model selection, and concurrency limits
  • Implemented filter_entries_with_llm method that scores each entry on a 0-5 scale and filters based on threshold
  • Updated logging levels for cleaner output (changed some log.warning to log.debug, removed verbose debug messages)

Reviewed changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated 10 comments.

File Description
watchers/rss_watcher.py Added LLM filter implementation with new configuration parsing, async filtering logic using semaphores for concurrency control, and integrated filtering into the entry processing pipeline
config.example.yaml Added example configuration for LLM filter feature showing model selection, custom prompt, and concurrency settings

Comment thread watchers/rss_watcher.py
Comment thread watchers/rss_watcher.py Outdated
Comment thread config.example.yaml
Comment thread watchers/rss_watcher.py Outdated
Comment thread watchers/rss_watcher.py Outdated
Comment thread watchers/rss_watcher.py Outdated
Comment thread watchers/rss_watcher.py
Comment thread watchers/rss_watcher.py Outdated
Comment thread watchers/rss_watcher.py Outdated
Comment thread watchers/rss_watcher.py
fanqiNO1 and others added 6 commits January 13, 2026 20:34
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
@Gennadiyev
Gennadiyev merged commit 3f4e297 into Gennadiyev:main Jan 13, 2026
1 check failed
@fanqiNO1
fanqiNO1 deleted the rss_filter branch January 13, 2026 12:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants