forked from gureckis/collecting_behavioral_data_online
-
Notifications
You must be signed in to change notification settings - Fork 0
/
lecture3.html
270 lines (207 loc) · 10.1 KB
/
lecture3.html
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
<!DOCTYPE html>
<html lang="en">
<head>
<meta charset="utf-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge">
<meta name="viewport" content="width=device-width, initial-scale=1.0">
<meta name="description" content="behavioral data collection, mechanical turk, psychology">
<meta name="author" content="todd m. gureckis">
<title>collecting behavioral data online - todd gureckis
(Lecture 3)
</title>
<!-- JQuery and D3.js -->
<script src="http://code.jquery.com/jquery-1.10.1.min.js"></script>
<script src="http://d3js.org/d3.v3.min.js" charset="utf-8"></script>
<!-- hit the Mint -->
<script src="http://gureckislab.org/mint/?js" type="text/javascript"></script>
<!-- Bootstrap core CSS -->
<link href="css/bootstrap.css" rel="stylesheet">
<!-- Custom styles for this template -->
<link href="css/cdbo.css" rel="stylesheet">
<!-- Just for debugging purposes. Don't actually copy this line! -->
<!--[if lt IE 9]><script src="../../docs-assets/js/ie8-responsive-file-warning.js"></script><![endif]-->
<!-- HTML5 shim and Respond.js IE8 support of HTML5 elements and media queries -->
<!--[if lt IE 9]>
<script src="https://oss.maxcdn.com/libs/html5shiv/3.7.0/html5shiv.js"></script>
<script src="https://oss.maxcdn.com/libs/respond.js/1.3.0/respond.min.js"></script>
<![endif]-->
</head>
<body>
<!-- Wrap all page content here -->
<div id="wrap">
<ol class="breadcrumb">
<li><h4><a href="http://gureckislab.org">gureckislab</a></h4></li>
<li><h4><a href="./">collecting behavioral data online</a></h4></li>
<li class="active">Lecture 3</li>
</ol>
<!-- Begin page content -->
<div class="container">
<div class="page-header">
<h2>Lecture 3:</h2><h1>Views from the other side of a request online</h1>
</div>
<center>
<a class="btn btn-default btn-md" href="slides.html?lecture=3">
<span class="glyphicon glyphicon-play-circle"></span> Lecture 3 Slide Deck
</a>
</center>
<br><br>
<p>
This week we're going to focus on what it is like to be a participant
in online studies. First, we're going to do a bit of work online ourselves
to get a sense of the type of tasks people have available and how your
experiment might compare. Second, we will talk about the
communities that online workers have developed to exchange information
about tasks and people requesting work. Finally, we'll dive into the ethics of
online experientation including labor rates, issues of fairness, and
possible legal issues involved in work-for-hire.
</p>
<hr>
<div class="panel panel-default">
<div class="panel-heading">
<h3 class="panel-title">Video 3.1</h3>
</div>
<div class="panel-body">
<div class="row">
<div class="span6">
<div class="flex-video widescreen" style="margin: 0 auto;text-align:center;">
<p>
Wherein your humble professor attempts to increase his salary by doing
online experiments for one hour. He also tries out worker tools that
give information on requesters. He offers his first proverb of
online data collection: "pay generously, have good quality/instruction checks, and disappear quickly"
</p>
<iframe src="//player.vimeo.com/video/86480926" width="500" height="375" frameborder="0" webkitallowfullscreen mozallowfullscreen allowfullscreen></iframe>
</div>
</div>
</div>
</div>
</div>
<div class="panel panel-default">
<div class="panel-heading">
<h3 class="panel-title">Video 3.2</h3>
</div>
<div class="panel-body">
<div class="row">
<div class="span6">
<div class="flex-video widescreen" style="margin: 0 auto;text-align:center;">
<p>
How to fork and clone a project on github.
</p>
<iframe src="//player.vimeo.com/video/86520527" width="500" height="375" frameborder="0" webkitallowfullscreen mozallowfullscreen allowfullscreen></iframe>
</div>
</div>
</div>
</div>
</div>
<div class="panel panel-default">
<div class="panel-heading">
<h3 class="panel-title">Video 3.3</h3>
</div>
<div class="panel-body">
<div class="row">
<div class="span6">
<div class="flex-video widescreen" style="margin: 0 auto;text-align:center;">
<p>
Basic introduction to Javascript in the browser and the built-in tools.
</p>
<iframe src="//player.vimeo.com/video/86524920" width="500" height="375" frameborder="0" webkitallowfullscreen mozallowfullscreen allowfullscreen></iframe>
</div>
</div>
</div>
</div>
</div>
<hr>
<h3>Assignments</h3>
<ol>
<li>Spend 30 minutes-1 hour on Mechanical Turk as a worker trying out various tasks. Please note your thoughs and experiences and share them in class next time.</li>
<li>Please try to fork and clone a copy of my demo project as explained in video 3.2.</li>
<li>Play around with the built-in browser development tools (see video 3.3).</li>
<li>Be ready to discuss the content of the videos and the readings below for class</li>
</ol>
<hr>
<h3>Assigned Readings</h3>
<div class="media">
<a class="pull-left" href="http://aclweb.org/anthology/J/J11/J11-2010.pdf">
<span class="glyphicon glyphicon-cloud-download"></span>
</a>
<div class="media-body">
Fort, K., Adda, G., Cohen, K.B. (2011). Amazon Mechanical Turk: Gold Mine or Coal Mine? <i>Computational Linguistics</i>. 37(2)
</div>
</div>
<div class="media">
<a class="pull-left" href="http://wtf.tw/ref/martin.pdf">
<span class="glyphicon glyphicon-cloud-download"></span>
</a>
<div class="media-body">
Martin, D., Hanrahan, B.V., O'Neil, J. and Gupta, N. (2014). Being a Turker <i>CSCW 2014</i> Feb. 15-19, 2014, Baltimore, Maryland. [<a href="http://bambuser.com/v/4174380">movie version</a>]
</div>
</div>
<div class="media">
<a class="pull-left" href="http://www.thenation.com/article/178241/how-crowdworkers-became-ghosts-digital-machine?utm_content=buffer2b563&utm_medium=social&utm_source=twitter.com&utm_campaign=buffer#">
<span class="glyphicon glyphicon-cloud-download"></span>
</a>
<div class="media-body">
Marvit, M.Z. (2014). How crowdworkers become the ghosts in the digital machine. <i>The Nation</i>
</div>
</div>
<hr>
<h3>Additional References and Links</h3>
<div class="media">
<a class="pull-left" href="http://turkopticon.differenceengines.com/">
<span class="glyphicon glyphicon-bookmark"></span>
</a>
<div class="media-body">
<b>Turkopticon</b> - a browser plugin that works with the AMT Hit page to give you rating on requesters
</div>
</div>
<div class="media">
<a class="pull-left" href=" http://turkernation.com/forum.php">
<span class="glyphicon glyphicon-bookmark"></span>
</a>
<div class="media-body">
<b>Turker Nation</b> - another popular forum for Amazon Mechanical Turk workers. This one has special features that are only available if you actively contribute to the site including tips on how to maximize
revenue.
</div>
</div>
<div class="media">
<a class="pull-left" href="http://www.turkalert.com/">
<span class="glyphicon glyphicon-bookmark"></span>
</a>
<div class="media-body">
<b>Turkalert</b> - A service that emails you when your favorite requester posts HITs
</div>
</div>
<div class="media">
<a class="pull-left" href="http://www.mturkgrind.com/forum.php">
<span class="glyphicon glyphicon-bookmark"></span>
</a>
<div class="media-body">
<b>mturkgrind</b> - a popular forum for Amazon Mechanical Turk workers
</div>
</div>
<div class="media">
<a class="pull-left" href="https://www.mturk.com/mturk/help?helpPage=worker">
<span class="glyphicon glyphicon-bookmark"></span>
</a>
<div class="media-body">
Amazon's <b>Mechanical Turk</b> worker FAQ - Answers to "How do I complete a HIT?", etc...
</div>
</div>
<div class="media">
<a class="pull-left" href="http://mturk-tracker.com/general/">
<span class="glyphicon glyphicon-bookmark"></span>
</a>
<div class="media-body">
<b>mturk Tracker</b> - a website that crawls AMT and monitors activity/rewards/etc...
</div>
</div>
<br>
</div>
</div>
<div id="footer">
<div class="container">
<p class="text-muted">(c) 2014 to <a href="http://gureckislab.org/~gureckis">tmg</a>. <a href="http://getbootstrap.com/">bootstrap</a>ped.</p>
</div>
</div>
</body>
</html>