Skip to content

P2: web crawl markdown needs chrome strip + page-specific titles before index #506

Description

@abojja9

Summary

Web crawl→markdown pilot (8/8 Moss docs pages) produced usable text but repeated documentation chrome in every page and site-generic titles, not page-specific. Bad for indexing quality without normalize step.

Evidence

Expected

Boilerplate stripping + canonical title extraction before index; metrics for chrome ratio.

Priority

P2 product quality for web KB (P1 if selling web ingest now).

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions