Skip to content
Open
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
71 changes: 56 additions & 15 deletions 02_activities/assignments/a2_survey_design_and_evaluation.md
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,7 @@ Select one of the scenarios below and design a survey to meet the need(s) outlin

For the **Canadian General Social Survey on Giving, Volunteering, and Participating, 2018 (cycle 33)**, conducted by Statistics Canada find any and all available documentation for the data gathered and identify and describe the survey features indicated below.

1. Sample type
1. Sample type:
2. Sample size
3. Target population
4. Sampling frame
Expand All @@ -40,38 +40,79 @@ For the **Canadian General Social Survey on Giving, Volunteering, and Participat

## Part A - Survey Design:

The number of your chosen topic: `#`
The number of your chosen topic: `1`

Describe the purpose of your survey:
```
write your answer here...
The purpose of the survey is to understand the underlying reasons behind the high turnover rate across departments within entry- and lower level positions
and identify how to make changes to improve employee satisfaction.
```

Describe your target population, sampling frame, sampling units, and observational units:
```
write your answer here...
The target population is current and previous employees who left over the past few months (let's say 3-6 months) in entry- and lower level positions across all departments in the company.

The sampling frame is HR records of all current employees and terminated employees who left within the last 3-6 months with record of contact information (personal email or phone).

The sampling units are each individual employee from above-mentioned groups.

The observational units are each employee who fills out the survey.

The overall sampling strategy is stratified random sampling to sample from current or past employees from various departments and tenure at the company.
Since each strata will be different sizes, we should sample more in larger groups.
```

Your 5-10 question survey:
```
1. write your question here...
2. write your question here...
3. write your question here...
4. write your question here...
5. write your question here...
6. write your question here... (optional)
7. write your question here... (optional)
8. write your question here... (optional)
9. write your question here... (optional)
10. write your question here... (optional)
1. Which best describes your employment status with the company?
A. Active B. Left the company in the last 3 months C. Left the company more than 3-6 months ago
2. Which department do/did you belong to?
()Product ()IT ()HR ()Finance ()Operation ()Other:XX
#For this question, the surveyee can choose multiple departments and they are also given the option to write in the Other option if their department was not mentioned.
#For the options, I would list all major departments in the company (options given only as examples).
3. How long have you been/were you working at the company?
A. less than 3 months B. 3-6 months C. 6 months- 1 year D. 1-2 years E. 2 years or more
4. How satisfied are you with your experience working at the company?
Scale 1- very dissatisfied, 2- dissatisfied, 3. Neutral, 4. satisfied, 5. very satisfied
5. Which factors have negatively impacted your work experience?
()Salary ()Benefits ()Workload ()Career support ()Work environment ()Schedule ()Other: XX
6. Which factors have positively impacted your work experience?
()Salary ()Benefits ()Workload ()Career support ()Work environment ()Schedule ()Other: XX
7. What is one thing you wish would change that would improve your experience?

#Question 5-7 are used to identify how changes can be implemented to improve employee retension.
Factors are given because these are common definitions that should apply to most employees, also makes it easier for employees to pinpoint what might have impacted their decisions quickly.
Question 7 is there for consideration of completeness of the survey. We want to get more feedback from the employees, even though it will take us longer to go through the responses.
However, answers to question 5 and 6 can be quicker changes for implementation.
```

## Part B - Survey Evaluation:

Identify and describe survey features:

```
write your answer here
1. Sample type: Stratified single random sampling without replacement
2. Sample size: The Target sample size was 20,000, and the actual number of respondents was 16,149.
3. Target population: Direct quotes are taken from document referenced in 13:
"The target population for the survey included all persons 15 years of age and older in Canada, excluding:
1. Residents of the Yukon, Northwest Territories, and Nunavut;
2. Full-time residents of institutions".
4. Sampling frame: Direct quotes are taken from the document referenced in 13:
"1. Lists of telephone numbers in use (both landline and cellular) available to Statistics Canada from various sources (Telephone companies, Census of population, etc.);
2. The Address Register (AR): List of all dwellings within the ten provinces".
5. Survey mode(s): Surveys were done as self-completed questionaire (rEQ) and computer assisted telephone interviews (iEQ), and also telephone interviews.
6. Timeline: Data was collected from September 4th to December 28th 2018.
7. Response rate: 41.9%
8. Weights: Weights were adjusted based on household (one household can be reached multiple times) and the removal of out-of-scope record and nonresponse adjustment.
Then person weight is calculated by "Initial Household Weight x Factor 1 x Number of eligible household members". The weight is then adjusted for rejective sampling, and external totals.
External totals include stratum adjustment, income adjustment, province-age-sex adjustment and rank ratio adjustments.
9. Data processing: Survey responses were made into forms for tabulation and data analysis.
10. Cleaning, imputation, etc: Imputation was done to provide complete data in the case of partial non-response and to fill in missing data for some item.
11. Sources of error: Some examples mentioned include interviewers misunderstanding instructions, respondents making mistakes when answering questions, answers are entered into the system incorrectly;
errors introduced when processing and the tabulation of the data.
12. Limitations, known biases, etc: Residents of certain regions were excluded from the survey. Survey also depends on phone calls or electronics use, therefore can be limiting for some people.
The data collection time is also relatively short which could limit responses from people.
13. Link to documentation and any additional sources used: 2018_GSS33GVP_PUMFGuide.pdf
```

## Rubric
Expand Down