Weeks 5–6 | Milestone: M2 — Data Ingestion Script
You have a question and a source. Now build the pipeline that pulls it. Phase 2 is about getting real data into your repo reliably.
By the end of Week 6, you will have:
- A working ingestion script (
scripts/ingest.py) that fetches and saves data locally - Raw data saved in
/data/raw/with timestamped filenames - A documented ingestion method (API, scraping, or manual download)
- Completed Milestone 2 submission
| Week | Focus | Deliverable |
|---|---|---|
| Week 5 | API fundamentals & request handling | Robust API ingestion script + sample raw pulls |
| Week 6 | Alternate ingestion paths (⚡ 3-path branching) | Working ingestion via API, scraping, or manual download |
Due: By Week 6
Pass criteria:
- Raw data landed successfully via API, scraping, or manual timestamped save
- Ingestion method documented in README
- Raw file saved in
/data/raw/with source URL and date recorded - All 3 ingestion paths (API / scraping / manual) are valid — deliverable format is the same
Submission: Open a Milestone Issue
Looking for datasets or community links? See Resources.