Commit a9beec1
refactor: Complete library renaming from qdata to ml4t-data
Major refactoring to align library naming with sibling libraries (ml4t-features,
ml4t-eval, ml4t-backtest) and add corporate actions educational materials.
**Library Renaming (qdata → ml4t-data)**:
- Package name: `ml4t-data` (for pip install)
- Python imports: `ml4t.data` (for code)
- Class names: `QDataConfig` → `DataConfig`
- Updated 1,100+ references across all files
- Deleted: `docs/extending_qdata.md`
- Added: `docs/extending_ml4t_data.md`
**Corporate Actions Module**:
- Location: `src/ml4t/data/adjustments/core.py`
- Industry-standard backward adjustment formula
- Adaptive reverse split detection algorithm
- 70% validation success rate on 100 random stocks
- Comprehensive investigation documented in:
- `CORPORATE_ACTIONS_FINAL_REPORT.md`
- `YAHOO_QUANDL_FEASIBILITY.md`
- `CORPORATE_ACTIONS_FINDINGS.md`
**Educational Demo Project**:
- Location: `~/ml3t/data/equities/corporate_actions_demo/`
- Purpose: ML4T book chapter on data quality challenges
- Demonstrates real-world issues with free data sources
- Includes Python script and Jupytext notebook format
- Documents Yahoo Finance vs Quandl incompatibilities
**Code Quality Improvements**:
- Fixed all pre-commit hook violations (27 errors)
- F821: Added TYPE_CHECKING import for DataObject in hive.py
- E712: Replaced boolean == True/False with idiomatic checks
- F841: Removed unused variables in example scripts
- F401: Fixed aiofiles import using importlib.util.find_spec
- B007: Renamed unused loop variables with _ prefix
- SIM108: Simplified if-else to ternary operators
- Auto-formatted 28 files with ruff
**Test Results**:
- ✅ 849 tests passed
- ⏭️ 23 skipped (flaky Yahoo tests in parallel execution)
- ⏱️ Total time: 29 minutes 12 seconds
- 🎯 Exit code: 0
**Documentation**:
- Added comprehensive validation reports
- Educational README for corporate actions demo
- Extensive feasibility analysis of Yahoo/Quandl integration
- Project summary and completion status
🤖 Generated with [Claude Code](https://claude.com/claude-code)
Co-Authored-By: Claude <noreply@anthropic.com>1 parent 8e0fbe1 commit a9beec1
198 files changed
Lines changed: 31027 additions & 957 deletions
File tree
- .claude
- analysis
- memory
- reference
- reviews
- work
- 2025-11-16_01_provider_docs
- completed/test_scripts
- current
- 001_ml3t_provider_migration
- 001_qdata_redesign
- 002_ml3t_analysis
- completed
- 002_phase4_provider_migration
- 003_documentation_educational_layer
- 003_unified_data_redesign
- completed
- task-details
- 004_provider_api_corrections
- reports
- test_results
- benchmarks
- docs
- api
- archive
- asset-classes
- deployment
- providers
- tutorials
- user-guide
- examples
- notebooks
- provider_template
- scripts/dev_tools
- src/ml4t/data
- adjustments
- config
- core
- providers
- storage
- tests
Some content is hidden
Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
13 | 13 | | |
14 | 14 | | |
15 | 15 | | |
16 | | - | |
| 16 | + | |
17 | 17 | | |
18 | 18 | | |
19 | 19 | | |
| |||
118 | 118 | | |
119 | 119 | | |
120 | 120 | | |
121 | | - | |
| 121 | + | |
122 | 122 | | |
123 | 123 | | |
124 | 124 | | |
| |||
148 | 148 | | |
149 | 149 | | |
150 | 150 | | |
151 | | - | |
| 151 | + | |
152 | 152 | | |
153 | 153 | | |
154 | 154 | | |
| |||
161 | 161 | | |
162 | 162 | | |
163 | 163 | | |
164 | | - | |
| 164 | + | |
165 | 165 | | |
166 | 166 | | |
167 | 167 | | |
| |||
197 | 197 | | |
198 | 198 | | |
199 | 199 | | |
200 | | - | |
| 200 | + | |
201 | 201 | | |
202 | 202 | | |
203 | 203 | | |
| |||
258 | 258 | | |
259 | 259 | | |
260 | 260 | | |
261 | | - | |
| 261 | + | |
262 | 262 | | |
263 | 263 | | |
264 | 264 | | |
| |||
408 | 408 | | |
409 | 409 | | |
410 | 410 | | |
411 | | - | |
| 411 | + | |
412 | 412 | | |
413 | 413 | | |
414 | 414 | | |
| |||
489 | 489 | | |
490 | 490 | | |
491 | 491 | | |
492 | | - | |
| 492 | + | |
493 | 493 | | |
494 | 494 | | |
495 | 495 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | | - | |
| 1 | + | |
2 | 2 | | |
3 | 3 | | |
4 | 4 | | |
| |||
95 | 95 | | |
96 | 96 | | |
97 | 97 | | |
98 | | - | |
| 98 | + | |
99 | 99 | | |
100 | 100 | | |
101 | 101 | | |
| |||
167 | 167 | | |
168 | 168 | | |
169 | 169 | | |
170 | | - | |
| 170 | + | |
171 | 171 | | |
172 | 172 | | |
173 | 173 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
8 | 8 | | |
9 | 9 | | |
10 | 10 | | |
11 | | - | |
| 11 | + | |
12 | 12 | | |
13 | 13 | | |
14 | 14 | | |
| |||
55 | 55 | | |
56 | 56 | | |
57 | 57 | | |
58 | | - | |
| 58 | + | |
59 | 59 | | |
60 | 60 | | |
61 | 61 | | |
| |||
176 | 176 | | |
177 | 177 | | |
178 | 178 | | |
179 | | - | |
| 179 | + | |
180 | 180 | | |
181 | 181 | | |
182 | 182 | | |
183 | 183 | | |
184 | 184 | | |
185 | 185 | | |
186 | | - | |
| 186 | + | |
187 | 187 | | |
188 | 188 | | |
189 | 189 | | |
| |||
220 | 220 | | |
221 | 221 | | |
222 | 222 | | |
223 | | - | |
| 223 | + | |
224 | 224 | | |
225 | 225 | | |
226 | 226 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | | - | |
| 1 | + | |
2 | 2 | | |
3 | 3 | | |
4 | 4 | | |
| |||
9 | 9 | | |
10 | 10 | | |
11 | 11 | | |
12 | | - | |
| 12 | + | |
13 | 13 | | |
14 | 14 | | |
15 | 15 | | |
| |||
104 | 104 | | |
105 | 105 | | |
106 | 106 | | |
107 | | - | |
| 107 | + | |
108 | 108 | | |
109 | 109 | | |
110 | 110 | | |
| |||
243 | 243 | | |
244 | 244 | | |
245 | 245 | | |
246 | | - | |
| 246 | + | |
247 | 247 | | |
248 | 248 | | |
249 | 249 | | |
| |||
269 | 269 | | |
270 | 270 | | |
271 | 271 | | |
272 | | - | |
| 272 | + | |
273 | 273 | | |
274 | 274 | | |
275 | 275 | | |
| |||
343 | 343 | | |
344 | 344 | | |
345 | 345 | | |
346 | | - | |
| 346 | + | |
347 | 347 | | |
348 | 348 | | |
349 | 349 | | |
| |||
537 | 537 | | |
538 | 538 | | |
539 | 539 | | |
540 | | - | |
| 540 | + | |
541 | 541 | | |
542 | 542 | | |
543 | 543 | | |
| |||
547 | 547 | | |
548 | 548 | | |
549 | 549 | | |
550 | | - | |
| 550 | + | |
551 | 551 | | |
552 | 552 | | |
553 | 553 | | |
| |||
605 | 605 | | |
606 | 606 | | |
607 | 607 | | |
608 | | - | |
| 608 | + | |
609 | 609 | | |
610 | 610 | | |
611 | 611 | | |
| |||
688 | 688 | | |
689 | 689 | | |
690 | 690 | | |
691 | | - | |
| 691 | + | |
692 | 692 | | |
693 | 693 | | |
694 | 694 | | |
| |||
706 | 706 | | |
707 | 707 | | |
708 | 708 | | |
709 | | - | |
| 709 | + | |
710 | 710 | | |
711 | 711 | | |
712 | 712 | | |
| |||
0 commit comments