-
Notifications
You must be signed in to change notification settings - Fork 2
/
hw10-data-wrangling.Rmd
156 lines (106 loc) · 7.15 KB
/
hw10-data-wrangling.Rmd
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
---
title: "Homework 10 - Data Wrangling"
output:
html_document:
number_sections: false
toc: no
---
> **Due**: 23 November by 11:00 pm
>
> **Weight**: This assignment is worth **4%** of your final grade.
>
> **Purpose, Skills, & Knowledge**: The purposes of this assignment are:
>
> - To practice exploring and wrangling data frames in R using the dplyr library
>
> **Assessment**: Each question indicates the % of the assignment grade, summing to 100%. The credit for each question will be assigned as follows:
>
> - 0% for not attempting a response.
> - 50% for attempting the question but with _major_ errors.
> - 75% for attempting the question but with _minor_ errors.
> - 100% for correctly answering the question.
>
> **Rules**:
>
> - Problems marked **SOLO** may not be worked on with other classmates, though you may consult instructors for help.
> - For problems marked **COLLABORATIVE**, you may work in groups of up to 3 students who are in this course this semester. You may not split up the work -- everyone must work on every problem. And you may not simply copy any code but rather truly work together.
> - Even though you work collaboratively, you still must submit your own solutions.
```{r, echo=FALSE}
library(nycflights13)
```
### 1) Staying organized [SOLO, 5%]
Download and use [this template](templates/hw10.zip) for your assignment. Inside the "hw10" folder, open and edit the R script called "hw10.R" and fill out your name, GW Net ID, and the names of anyone you worked with on this assignment.
### 2) Load the data [SOLO, 5%]
For this assignment, we will work with data on flights from New York City airports during 2013. The data are accessible from the **nycflights13** package. Write R code to install and then load the package.
### 3) Inspect the data [SOLO, 10%]
Look at the datasets that are included in this package:
```{r, eval=FALSE}
data(package = "nycflights13")
```
```
Data sets in package 'nycflights13':
airlines Airline names.
airports Airport metadata
flights Flights data
planes Plane metadata.
weather Hourly weather data
```
Write some code to preview and summarize each of these data frames using some of the methods we've used in class. You should be able to quickly get an understanding of what variables are included in each data frame and their nature. For each dataset, consider the following questions in your exploration (you don't have to write out answers to these questions - just write code to help you answer them by previewing the data in different ways):
- What is the total size of each data frame?
- What type of data is each variable (numeric, character, logical, date)?
- Do any variables have missing values? Why might that be?
- What are the "boundaries" of each period of observation:
- For numeric variables, what are the min and max values?
- For character variables, what are the unique values in the variable?
- For date variables, what time period do the observations in these data frames span?
## 4) Answer questions about the data
Use the data frames in the **nycflights13** library to answer the following questions. For each question, write R code to find the solution. Leave comments where appropriate to explain what you are doing, and then write your final answer as a comment at the end.
For example, if the question was "how many observations are in the `flights` data frame?", here is an acceptable answer:
```{r}
# Find the number of rows in the flights data frame
nrow(flights)
```
```{r}
# Answer: There are 336,776 observations in the flights data frame
```
You do not have to use the **dplyr** library functions (i.e. `filter()`, `arrange()`, `mutate()`, etc.) to answer these questions, but they generally make it easier.
### a) [SOLO, 5%]
How many flights out of NYC airports in 2013 had an arrival delay of two or more hours? Hint: use `filter()`
### b) [SOLO, 5%]
How many flights out of NYC airports in 2013 departed in fall semester (i.e. the months August - December, inclusive)? Hint: use `filter()`
### c) [SOLO, 5%]
How many flights out of NYC airports in 2013 were operated by United, American, or Delta airlines? Hint: use `filter()`
### d) [SOLO, 5%]
List the top 3 airlines (by name, not carrier code) that had the highest delay time of any one flight leaving a NYC airport in 2013. Hint: use `arrange()`
### e) [SOLO, 5%]
How many flights out of NYC airports in 2013 flew to the 3 major DC-area airports: Reagan National, Dulles, or BWI? Hint: use `filter()`
### f) [COLLABORATIVE, 10%]
What is the year manufactured and tail number of the oldest airplane that any one airline used in 2013 to fly out of NYC airports, and which airline operated that plane? Hint: use `arrange()` and `filter()`
### g) [COLLABORATIVE, 10%]
Using the `flights` data frame, compute a new variable `speed` (in miles per hour) using the `air_time` and `distance` variables. For the fastest flight in the dataset, what was its speed and what were the origin and destination airport codes? Hint: use `mutate()` and `arrange()`
### h) [COLLABORATIVE, 10%]
Of all the flights in 2013 departing from NYC airports, list the top 3 destinations (airport names, not airport codes) with the highest mean arrival delay. Hint: Use a "pipeline" of `group_by()`, `summarise()`, and `arrange()`. Don't forget to filter out any `NA` values before summarizing!
### i) [COLLABORATIVE, 10%]
Use the `flights` data frame to create a new summary data frame called `dailyDelaySummary` that contains the following variables for each day in 2013:
- `meanDepDelay`: the mean departure delay (in minutes)
- `numDelayedFlights`: the total number of delayed flights
Save this file in your "data" folder as "dailyDelaySummary.csv"
Hint: Use a "pipeline" of `group_by()` and `summarise()`, and don't forget to filter out any `NA` values before summarizing!
### j) [COLLABORATIVE, 10%]
Using the `dailyDelaySummary` data frame that you created in part i), answer the following two questions:
- Find the day in 2013 with the highest number of delayed flights. On that day, how many flights were delayed, and what was the mean delay time (in minutes)?
- Find the day in 2013 with the highest mean departure delay (in minutes). On that day, how many flights were delayed and what was the mean delay time (in minutes)?
### 5) Submit your files on Blackboard [SOLO, 5%]
Create a zip file of all files in your R project folder for this assignment and submit the zip file on Blackboard by the due deadline.
---
### Bonus Credit 1) [SOLO, 1%]
How many flights have a missing departure time? What might these rows represent?
### Bonus Credit 2) [SOLO, 1%]
Which flights (i.e. carrier + flight) departed every day of the year, and which airports did they fly to?
### Bonus Credit 3) [SOLO, 2%]
Use the `flights` data frame to create a `season` variable. The seasons are defined as the following:
- Spring: March, April, May
- Summer: June, July, August
- Fall: September, October, November
- Winter: December, January, February
What season experiences the largest mean delay, and why might that be? Hint: Use a "pipeline" of `mutate`, `group_by()` and `summarise()`. Don't forget to filter out any `NA` values before summarizing!