Repository navigation
feat: add opt-in public web sources to operator research - #96
Open
georgeatparallel wants to merge 1 commit into
Open
georgeatparallel wants to merge 1 commit into
georgeatparallel wants to merge 1 commit into
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What & why
Autonomous research builds its source catalog from YouTube trends and competitor videos. For an explicit public topic, the native planning pass currently has no way to include an official documentation page or article in that catalog. This adds a separate Parallel MCP source feed enabled only by
PARALLEL_RESEARCH_TOPIC. It supplies up to five public sources, preserves their exact URLs in the research catalog and plan citations, and lets the template fallback cite the configured topic. Public sources stay separate from popularity signals. The feed is off by default, sends only the configured topic as research input, uses anonymous access, and falls back to existing research on errors or a 20-second deadline. Setup and opt-out are documented with a link to Parallel MCP setup.I work at Parallel. This patch was prepared with AI assistance and checked by an independent automated reviewer.
Checklist
package-lock.jsonregeneration unless the PR is specifically about dependenciesnpm run lintpassesnpm testpasses (add a test if you fixed a bug)masterHow I tested it
npm run lintpassed;npm testpassed all 50 system tests.Optional Public Source Researchsystem test runs nativeresearchAndPlanChannelagainst a local MCP fixture. It checks the original URL, including escaped query and fragment, inresearch.publicSources, the deduplicatedsourceCatalog, and the resulting plan. It also checks retained YouTube evidence, citation allowlisting, default-off and opt-out behavior, JSON/SSE responses, MCP session/protocol headers, the product User-Agent on HTTP traffic, absence of provider credentials, and empty/error/rate-limit/deadline fallbacks.researchAndPlanChannelwith live search and deterministic doubles for unrelated YouTube, database history, and AI text services. The fallback plan preserved the returned URLs, including https://nodejs.org/api/test.html, exactly from the research sources. All Parallel requests carriedyoutube-automation-agent/2.11.0 (public-source-feed)and no Parallel credential. This validates native research and planning; no videos were generated or published.