-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathpipeline.txt
18 lines (10 loc) · 1.06 KB
/
pipeline.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
1. fetch all fixture deadlines with https://fantasy.premierleague.com/api/fixtures/ and add to fixtures collection
2. fetch all player ids with https://fantasy.premierleague.com/api/bootstrap-static/ and look a the "elements" list, do an upsert of this with each gameweek to ensure that any loans, transfers etc are taken into account - add this to players collection
3. after each week use the https://fantasy.premierleague.com/api/fixtures/ to record all events (OGS, red cards, missed penalties) in the events collection with player id included
4. to capture results we use the https://fantasy.premierleague.com/api/entry/{team-id}/event/{GW}/picks/ endpoint and store this in the results collection
the weekly pipeline needs to make sure all fpl data is updated, such as players being in the correct teams etc
- Check if a fixture happened
- if it has kick off hourly script to check if leagues have been updated
- if they have run upsert transformation
- also make a pipeline that updates fixtures dates
- fetch user results with running total