Skip to content

test(diagnosis): regression lock for non-ASCII terms in content gap analysis#221

Merged
himanshu231204 merged 2 commits into
OpenAgentHQ:mainfrom
Nitjsefnie-OSC:fix/content-gap-unicode
Jul 23, 2026
Merged

test(diagnosis): regression lock for non-ASCII terms in content gap analysis#221
himanshu231204 merged 2 commits into
OpenAgentHQ:mainfrom
Nitjsefnie-OSC:fix/content-gap-unicode

Conversation

@Nitjsefnie

Copy link
Copy Markdown
Contributor

Closes #64

Heads-up: the production fix for this is already on main — commit 78c92a4 ("Fix #122") changed the exact [a-zA-Z]{4,}\w{4,} regex #64 asks about, so #64 is effectively a duplicate of #122. What was still missing is a regression test, so this PR is test-only: 4 tests exercising the issue's accented/CJK examples, verified to fail against the old [a-zA-Z] pattern (checked live by temporarily reverting the regex) and pass against \w.

If you'd rather just close #64 as a duplicate without the test lock, no hard feelings — say so and I'll close this.

Gates: uv run pytest tests/unit — 938 passed, 4 skipped (+4 new).

Generated by Claude Fable 5 (brief, review), Claude Opus 4.8 (implementation)

Nitjsefnie and others added 2 commits July 23, 2026 18:07
Add regression tests for OpenAgentHQ#64: content gap analysis must extract accented
Latin keywords (French "différence", German "Größe") and non-empty keyword
sets for CJK questions, rather than dropping them as the old
`[a-zA-Z]{4,}` regex did.

The production fix (switching to `\w{4,}`) already landed on main via
commit 78c92a4 ("Fix OpenAgentHQ#122"), but there was no test guarding it — these
tests fail against `[a-zA-Z]{4,}` and pass against `\w{4,}`, so a
regression back to ASCII-only extraction would be caught.

Refs OpenAgentHQ#64

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
@himanshu231204
himanshu231204 merged commit ae0f3fb into OpenAgentHQ:main Jul 23, 2026
8 checks passed
@github-actions

Copy link
Copy Markdown

🎉 Congratulations @Nitjsefnie!

Your pull request has been successfully merged into main. 🚀

Thank you for contributing to OpenAgentHQ and helping improve the project.

We truly appreciate your contribution and hope to see you back with more amazing PRs!

Happy Open Sourcing! ❤️

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Fix: Non-ASCII characters silently ignored in content gap analysis diagnosis(chunking): non-ASCII characters silently ignored in content gap analysis

2 participants