Skip to content

Refactor modules to be in a single class and dataframe backend checking#379

Closed
ryantwolf wants to merge 11 commits intomainfrom
rywolf/filter-refactor
Closed

Refactor modules to be in a single class and dataframe backend checking#379
ryantwolf wants to merge 11 commits intomainfrom
rywolf/filter-refactor

Conversation

@ryantwolf
Copy link
Copy Markdown
Contributor

@ryantwolf ryantwolf commented Nov 18, 2024

Description

This PR does a couple of things:

  • Refactor ScoreFilter and DocumentFilter to be a single module.
  • Refactor Modify and DocumentModifier to be a single module.
  • Add a generic Module abstract base class that can validate the necessary backend of each module.
  • Add a ToBackend module that converts between backends in a pipeline.

Usage

# Add snippet demonstrating usage

Checklist

  • I am familiar with the Contributing Guide.
  • New or Existing tests cover these changes.
  • The documentation is up to date with these changes.

Signed-off-by: Ryan Wolf <rywolf@nvidia.com>
Signed-off-by: Ryan Wolf <rywolf@nvidia.com>
Signed-off-by: Ryan Wolf <rywolf@nvidia.com>
Signed-off-by: Ryan Wolf <rywolf@nvidia.com>
Signed-off-by: Ryan Wolf <rywolf@nvidia.com>
Signed-off-by: Ryan Wolf <rywolf@nvidia.com>
Signed-off-by: Ryan Wolf <rywolf@nvidia.com>
Signed-off-by: Ryan Wolf <rywolf@nvidia.com>
Signed-off-by: Ryan Wolf <rywolf@nvidia.com>
Signed-off-by: Ryan Wolf <rywolf@nvidia.com>
Signed-off-by: Ryan Wolf <rywolf@nvidia.com>
@ryantwolf ryantwolf changed the title Refactor the Filtering to Combing ScoreFilter and DocumentFilter Refactor modules to be in a single class and dataframe backend checking Nov 18, 2024
@sarahyurick
Copy link
Copy Markdown
Contributor

Out of date.

@ayushdg ayushdg deleted the rywolf/filter-refactor branch August 14, 2025 14:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants