Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ORA-803] Add dw-connector for Nitro-Trino intergration #311

Open
wants to merge 8 commits into
base: main
Choose a base branch
from

Conversation

vdittgen
Copy link

@vdittgen vdittgen commented Feb 25, 2025

Runway story

A flexible Ruby data warehouse connector library that provides a standardized interface for querying different data warehouse engines. Currently supports Trino with an extensible architecture for adding other engines.

Features

  • Unified interface for querying data warehouses
  • Built-in support for Trino
  • Extensible adapter system for adding new data warehouse engines
  • Flexible data transformation options
  • Environment-based configuration with overrides
  • Automatic query pagination handling
  • Error handling

@vdittgen vdittgen self-assigned this Feb 25, 2025
@vdittgen vdittgen requested a review from a team as a code owner February 25, 2025 01:25
@powerhome-portal
Copy link

A change to documentation files was detected in your PR. Please visit this link to preview changes: https://portal-staging.powerapp.cloud/docs?filters[kind]=all&filters[user]=all&filters[namespaceFilter]=ora-dw-connector

@vdittgen vdittgen requested a review from a team February 25, 2025 01:25
@vdittgen vdittgen marked this pull request as draft February 25, 2025 01:26
@vdittgen vdittgen marked this pull request as ready for review February 27, 2025 13:15
xjunior
xjunior previously approved these changes Feb 27, 2025
@vdittgen
Copy link
Author

vdittgen commented Mar 7, 2025

@xjunior Could you please review it again?

@vdittgen vdittgen requested a review from Copilot March 7, 2025 17:47
Copy link

@Copilot Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

PR Overview

A new Ruby gem ("dw_connector") is being introduced to standardize querying across data warehouse engines with built‐in support for Trino and an extensible adapter system.

  • Added build, test, lint, and release tasks in the Rakefile
  • Implemented the Trino adapter and updated the RepositoryFactory to register and create adapters
  • Included comprehensive tests and documentation updates for the connector

Reviewed Changes

File Description
packages/dw_connector/Rakefile Added tasks for spec, rubocop, and gem release procedures
packages/dw_connector/Gemfile Defined development and test dependencies for the connector
packages/dw_connector/spec/** Added tests for repository functions and adapter behavior
packages/dw_connector/docs/** Updated documentation and contributing guidelines
packages/dw_connector/lib/dw_connector/adapters/trino_repository.rb Introduced the Trino adapter with query execution and pagination handling
packages/dw_connector/lib/dw_connector/repository_factory.rb Defined dynamic adapter registration and instantiation
packages/dw_connector/lib/dw_connector/data_warehouse_repository.rb Added default transformation options and methods for query response transformation
packages/dw_connector/lib/dw_connector.rb Condensed setup by requiring necessary files and registering the default adapter
packages/dw_connector/lib/dw_connector/version.rb Set the gem version

Copilot reviewed 23 out of 23 changed files in this pull request and generated 1 comment.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants