Skip to content

Fix: ArXiv API Migration - OAI-PMH Implementation #243

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
Opsmithe wants to merge 36 commits into
base: main
Choose a base branch
from
Open

Fix: ArXiv API Migration - OAI-PMH Implementation #243

Show file tree
Hide file tree
Changes from 32 commits
Commits
Show all changes
36 commits
Select commit Hold shift + click to select a range
74a099c
Add simple name output script
Opsmithe Nov 8, 2025
586accc
Update arxiv_fetch.py - minimal recent changes
Opsmithe Nov 8, 2025
19b32bb
Delete output_name.py
Opsmithe Nov 8, 2025
d3f0fe3
Update arxiv_fetch.py with last 12 commits from feature/arxiv
Opsmithe Nov 8, 2025
d0facfc
style: fix formatting in arxiv_fetch.py to meet project standards
Opsmithe Nov 8, 2025
f371e13
chore: increase ArXiv fetch limit to 2000 CC-licensed papers
Opsmithe Nov 9, 2025
346b90f
chore: adjust ArXiv fetch parameters to 1000 limit and 5 years back
Opsmithe Nov 9, 2025
3e77cac
docs: update arXiv API documentation to include OAI-PMH interface
Opsmithe Nov 9, 2025
6ef2736
style: apply consistent hard wrapping to arXiv section in sources.md
Opsmithe Nov 9, 2025
ad0ce28
style: fix line length and trailing whitespace issues
Opsmithe Nov 9, 2025
82f94fa
feat: Migrate DOAJ API from v3 to v4 with enhanced data collection
Opsmithe Nov 10, 2025
cb43515
data: Add DOAJ v4 API test data with enhanced publisher and article i…
Opsmithe Nov 10, 2025
1b78e21
feat: Add granular CC license component analysis to DOAJ v4 integration
Opsmithe Nov 10, 2025
1a6bf8b
docs: Add comprehensive DOAJ API v4 migration documentation
Opsmithe Nov 10, 2025
d7b73b2
refactor: Remove redundant license details functionality from DOAJ v4…
Opsmithe Nov 10, 2025
248748b
refactor: Remove DOAJ content from arxiv-minimal-fix branch
Opsmithe Nov 10, 2025
2945f63
Improve arXiv license extraction with stricter CC validation and spec…
Opsmithe Nov 11, 2025
f1fdccb
Replace 'Unknown' with more descriptive terms and rename variables in…
Opsmithe Nov 11, 2025
6431e72
Update exception handler to use consistent generic terms
Opsmithe Nov 11, 2025
faaa174
Improve code readability by replacing vague variable names with descr…
Opsmithe Nov 11, 2025
2a3bcbb
Improve code readability by replacing vague variable names with descr…
Opsmithe Nov 11, 2025
5db5b81
Replace vague variable names in query_arxiv function for better reada…
Opsmithe Nov 11, 2025
0921353
Complete variable name refactoring for improved code readability
Opsmithe Nov 11, 2025
af1e59a
Remove data files from PR - keep only arxiv_fetch.py changes
Opsmithe Nov 11, 2025
6c95f00
Restore output_name.py - keep only arxiv_fetch.py and sources.md changes
Opsmithe Nov 11, 2025
4149a18
Enhance arXiv documentation with OAI-PMH interface details
Opsmithe Nov 11, 2025
8ed2cdc
Apply consistent hard wrapping to arXiv section in sources.md
Opsmithe Nov 11, 2025
2d3fd5a
Fix static analysis issues: trailing whitespace and code formatting
Opsmithe Nov 11, 2025
5739ad3
Fix arXiv API documentation links in sources.md
Opsmithe Nov 12, 2025
5cee2ac
Update arXiv section to focus on OAI-PMH API and add data format details
Opsmithe Nov 12, 2025
bc70c78
Delete output_name.py
Opsmithe Nov 12, 2025
8fd22b0
Simplify Non-CC license display to remove URL from output
Opsmithe Nov 13, 2025
3a6b24f
Add CC CERTIFICATION 1.0 US license mapping
Opsmithe Nov 15, 2025
b6e19a9
Order license mapping alphabetically
Opsmithe Nov 15, 2025
cd24b78
Simplify author count bucketing to continuous logic block
Opsmithe Nov 15, 2025
04a74a0
Fix license filtering to use startswith instead of substring matching
Opsmithe Nov 15, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading