feat: Add Hydra configuration system for ML experiments#95
Merged
gelluisaac merged 4 commits intoTraqora:mainfrom Mar 24, 2026
Merged
feat: Add Hydra configuration system for ML experiments#95gelluisaac merged 4 commits intoTraqora:mainfrom
gelluisaac merged 4 commits intoTraqora:mainfrom
Conversation
- Implement comprehensive Hydra configuration system for easy experiment management - Create YAML configs for model, training, and data parameters - Add flexible train.py script supporting command-line overrides - Include pre-configured experiments (debug, baseline, hyperparameter search) - Enable hyperparameter sweeps with --multirun functionality - Add comprehensive documentation and usage examples Features: - Easy parameter override: python train.py model.lr=0.001 - Hyperparameter sweeps: python train.py --multirun training.lr=0.001,0.01,0.1 - Pre-configured experiments for common use cases - Automatic output organization and logging - Model checkpointing with early stopping - Support for multiple datasets and model architectures - Comprehensive documentation in docs/experiment-configs.md Configuration Structure: - configs/config.yaml: Main configuration with defaults - configs/model/gcn.yaml: GCN model configurations - configs/training/default.yaml: Training hyperparameters - configs/data/cora.yaml: Dataset configurations - configs/experiments/: Pre-configured experiment setups This enables users to easily run experiments with simple command-line overrides and systematic hyperparameter searches.
|
@tecch-wiz Great news! 🎉 Based on an automated assessment of this PR, the linked Wave issue(s) no longer count against your application limits. You can now already apply to more issues while waiting for a review of this PR. Keep up the great work! 🚀 |
- Fix experiment configuration paths and structure - Add test_config.py for testing Hydra without PyTorch dependencies - Create requirements-minimal.txt for quick setup - Add requirements-cpu.txt for CPU-only PyTorch installation - Update experiment configs with proper defaults and _self_ - Add README_HYDRA.md with quick start guide - Successfully test command-line overrides and pre-configured experiments Features: - Working parameter overrides: python test_config.py experiments.training.lr=0.001 - Pre-configured experiments: debug, baseline, hyperparameter search - Virtual environment setup with minimal dependencies - Automatic output organization and configuration tracking Tested and verified: - Configuration loading and merging - Command-line parameter overrides - Experiment selection with --config-name - Combined overrides working correctly - Output directory structure and logging
- Add docs/conf.py with comprehensive Sphinx configuration - Create docs/index.md as main documentation homepage - Set up Sphinx RTD theme with modern extensions - Enable MyST parser for Markdown support - Configure autodoc, napoleon, and type hints - Add intersphinx links to Python, NumPy, Pandas, PyTorch - Successfully build HTML documentation in docs/_build/ - Include all required static assets and themes Features: - Modern responsive theme (Read the Docs) - Markdown support with MyST parser - Automatic API documentation generation - Code syntax highlighting and copy buttons - Search functionality and navigation - Cross-references to popular Python libraries The documentation system is now fully functional and ready for content expansion.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Features:
Configuration Structure:
This enables users to easily run experiments with simple command-line overrides and systematic hyperparameter searches.
closes #79