Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

LitQA2 downloading and question creation functionality #386

Merged
merged 6 commits into from
Sep 12, 2024

Conversation

jamesbraza
Copy link
Collaborator

This PR creates functions for:

  • Downloading LitQA2 from HuggingFace Hub, facilitated by a datasets extra
    • (and CI caching of them)
  • Making LitQA2 formatted questions, with a test

@jamesbraza jamesbraza added the enhancement New feature or request label Sep 12, 2024
@jamesbraza jamesbraza self-assigned this Sep 12, 2024
@dosubot dosubot bot added the size:L This PR changes 100-499 lines, ignoring generated files. label Sep 12, 2024
paperqa/settings.py Outdated Show resolved Hide resolved
@@ -0,0 +1,195 @@
"""Utilities for working with LitQA v1 and v2."""
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nice -- it's cool these are centralized in paper-qa now!

@dosubot dosubot bot added the lgtm This PR has been approved by a maintainer label Sep 12, 2024
@jamesbraza jamesbraza enabled auto-merge (squash) September 12, 2024 22:32
@jamesbraza jamesbraza merged commit 72f13b5 into main Sep 12, 2024
5 checks passed
@jamesbraza jamesbraza deleted the litqa-integration branch September 12, 2024 23:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request lgtm This PR has been approved by a maintainer size:L This PR changes 100-499 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants