GCP BigQuery Pipeline: Authentication & Configuration

[JGrubb]

Overview

Implement GCP service account JSON authentication and configuration structure for BigQuery billing data pipeline.

Tasks

• Add GCP section to config.toml (project_id, dataset, table, service_account_path)
• Implement service account JSON authentication
• Create basic BigQuery client initialization
• Add GCP configuration validation

Acceptance Criteria

• Configuration supports GCP project ID, dataset, table name, and service account path
• Service account JSON authentication working
• Basic connection to BigQuery established

Dependencies

None - foundational work

Architecture

• Follow existing AWS pipeline patterns in vendors/ directory
• Integrate with existing config.py structure
• Use google-cloud-bigquery library