-
Notifications
You must be signed in to change notification settings - Fork 0
/
challenges.json
219 lines (219 loc) · 12.7 KB
/
challenges.json
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
[
{
"text": "He saw John F. Kennedy just before the assassination.",
"language": "en",
"source": "Nouvel et al (2016)",
"challenges": ["misclassification", "boundary detection"],
"critical_phrases": ["John F. Kennedy"]
},
{
"text": "His trip through John F. Kennedy went well.",
"language": "en",
"source": "Nouvel et al (2016)",
"challenges": ["misclassification", "boundary detection"],
"critical_phrases": ["John F. Kennedy"]
},
{
"text": "The Abrams tank was widely tested during the Gulfwar.",
"language": "en",
"source": "Nouvel et al (2016)",
"challenges": ["misclassification"],
"critical_phrases": ["Abrams"]
},
{
"text": "The Star Wars VII movie was directed by Abrams.",
"language": "en",
"source": "Nouvel et al (2016)",
"challenges": ["misclassification"],
"critical_phrases": ["Abrams"]
},
{
"text": "Washington was born into slavery on the farm of James Burroughs.",
"language": "en",
"source": "Jurafsky, D. and Martin, J. H. (2020). Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition. Third Edition draft.",
"challenges": ["misclassification"],
"critical_phrases": ["Washington"]
},
{
"text": "Washington went up 2 games to 1 in the four-game series.",
"language": "en",
"source": "Jurafsky, D. and Martin, J. H. (2020). Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition. Third Edition draft.",
"challenges": ["misclassification"],
"critical_phrases": ["Washington"]
},
{
"text": "Blair arrived in Washington for what may well be his last state visit.",
"language": "en",
"source": "Jurafsky, D. and Martin, J. H. (2020). Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition. Third Edition draft.",
"challenges": ["misclassification"],
"critical_phrases": ["Washington"]
},
{
"text": "In June, Washington passed a primary seatbelt law.",
"language": "en",
"source": "Jurafsky, D. and Martin, J. H. (2020). Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition. Third Edition draft.",
"challenges": ["misclassification"],
"critical_phrases": ["Washington"]
},
{
"text": "Und nun will die Bundesregierung Gerhard Schröder Büro und Personal streichen.",
"language": "de",
"source": "tagesthemen, 2022-05-18",
"challenges": ["boundary detection"],
"critical_phrases": ["die Bundesregierung", "Gerhard Schröder"]
},
{
"text": "In Corona-Hochburgen wie München und Hamburg nähern sich einige Krankenhäuser der Kapazitätsgrenze.",
"language": "de",
"source": "Spiegel.de, 2020-03-27",
"challenges": ["neologism"],
"critical_phrases": ["Corona-Hochburgen"]
},
{
"text": "This mistaken approach is made plain as Secretary for Commerce and Economic Development Gregory So Kam-leung was recently quoted as saying, \"(The government) will try to strike a balance between economic development and the livelihoods of people.\"",
"language": "en",
"source": "China Daily, HK Edition 03/11/2014 page10",
"challenges": ["foreign name"],
"critical_phrases": ["Gregory So Kam-leung"]
},
{
"text": "With options running out, the 18-year-old Wong announced at a rally late Monday that he and two other members of his group would go on an indefinite hunger strike to press demands that the Hong Kong government drop restrictions on inaugural 2017 elections for the city’s top leader.",
"language": "en",
"source": "China Post, 2014-12-02",
"challenges": ["boundary detection", "foreign name"],
"critical_phrases": ["18-year-old Wong"]
},
{
"text": "Chow Tai Fook plans to double its number of points of sale, including concessionaires and stand-alone outlets, in the next 10 years. ",
"language": "en",
"source": "China Daily, 2014-11-24",
"challenges": ["misclassification", "foreign name"],
"critical_phrases": ["Chow Tai Fook"]
},
{
"text": "Founded in 1929 in the southern city of Guangzhou, the jeweler was named after founder Chow Chi-yuen. \"Tai Fook\" means \"big blessing\" in Chinese.",
"language": "en",
"source": "China Daily, 2014-11-24",
"challenges": ["misclassification", "foreign name"],
"critical_phrases": ["Guangzhou", "Chow Chi-yuen"]
},
{
"text": "Hong Kong's students tell Xi they don't want a revolution.",
"language": "en",
"source": "Japan Times, 2014-10-12",
"challenges": ["foreign name"],
"critical_phrases": ["Xi"]
},
{
"text": "Agnes Chow Ting, 17, stepped down as a spokeswoman for Scholarism after 2½ years, citing exhaustion, saying that she’s “unable to shoulder such a great burden,” in a post Saturday on Scholarism’s Facebook page.",
"language": "en",
"source": "Japan Times, 2014-10-12",
"challenges": ["foreign name", "misclassification"],
"critical_phrases": ["Agnes Chow Ting", "Scholarism", "Facebook page"]
},
{
"text": "In another sign of tensions in the city, the newspaper Apple Daily, which is owned by prodemocracy activist Jimmy Lai, said on its website late Saturday that a truck was parked outside its headquarters in Tseung Kwan O, blocking access and threatening to prevent the newspaper being distributed.",
"language": "en",
"source": "Japan Times, 2014-10-12",
"challenges": ["Small organization", "foreign name"],
"critical_phrases": ["Apple Daily", "Tseung Kwan O"]
},
{
"text": "La Granda (Gozón), 23 may (EFECOM).",
"language": "es",
"source": "CoNLL 2002",
"challenges": ["boundary detection"],
"critical_phrases": ["La Granda"]
},
{
"text": "Romario, que en 1995, cuando militaba en el Flamengo, discutió públicamente con Luxemburgo - entonces técnico de ese club y quien, tras el enfrentamiento dejó la institución - , se mostró más obediente esta vez y reconoció que \"realmente sería muy difícil\" participar en el encuentro ante Inglaterra.",
"language": "es",
"source": "CoNLL 2002",
"challenges": ["misclassification"],
"critical_phrases": ["Luxemburgo"]
},
{
"text": "La cotización de las acciones españolas en la Bolsa de valores de París, fue hoy, martes, la siguiente: ACTUAL VARIACION TELEFONICA 20,66 euros + 0,63% BANCO POPULAR no cotizó - La Manga, 23 may (EFE).",
"language": "es",
"source": "CoNLL 2002",
"challenges": ["misclassification"],
"critical_phrases": ["TELEFONICA", "BANCO POPULAR"]
},
{
"text": "La venta anticipada de localidades para las dos representaciones que ofrecerá el actor Rafael Alvarez, \"El Brujo\" , de la obra \"El contrabajo\" , de Patrick Süskind, comenzará mañana miércoles a las 20:00 horas en la sala Trajano de Mérida.",
"language": "es",
"source": "CoNLL 2002",
"challenges": ["boundary detection"],
"critical_phrases": ["la sala Trajano", "Mérida"]
},
{
"text": "De verklaring van Sainovic komt daags na een onverwacht bezoek aan Kosovo door Gorica Gajevic, de secretaris-generaal van de socialistische partij van Milosevic.",
"language": "nl",
"source": "De Morgen, 2000-09-01",
"challenges": ["foreign name", "misclassification"],
"critical_phrases": ["Sainovic", "Gorica Gajevic", "Milosevic"]
},
{
"text": "Stainthorp noemt ze wel prima voor volwassenen en oudere scholieren, maar het iele lijntje dat er uitkomt, is niet van aard om kinderen veel controle te geven over dit schrijfinstrument.",
"language": "nl",
"source": "De Morgen, 2000-09-01",
"challenges": ["foreign name", "misclassification"],
"critical_phrases": ["Stainthorp"]
},
{
"text": "Wij gaan niet wachten tot er op de Europese raad een onderwijshervorming uit de bus komt, want dat duurt misschien nog twintig jaar.",
"language": "nl",
"source": "De Morgen, 2000-09-01",
"challenges": ["misclassification", "boundary detection"],
"critical_phrases": ["Europese raad"]
},
{
"text": "In de Creative Hair & Nails Design-zaak aan de Compton Boulevard wordt daar iets anders tegen aangekeken.",
"language": "nl",
"source":"De Morgen, 2000-09-01",
"challenges": ["boundary detection"],
"critical_phrases": ["Creative Hair & Nails Design-zaak"]
},
{
"text": "Het feit dat een artiest als Ronan Keating van Boyzone ondertussen de TMF Awards in zijn agenda heeft genoteerd benadrukt volgens Castelain de internationale aantrekkingskracht van de TMF Awards.",
"language": "nl",
"source": "CoNLL 2002",
"challenges": ["boundary detection", "misclassification"],
"critical_phrases": ["Ronan Keating", "Boyzone", "Castelain"]
},
{
"text": "Hij is geen wraakzuchtige tiran als Poetin en geen Mao die alles ontmantelt. Maar als Xi Jinping straks aan een derde ambtstermijn begint, zal hij het nieuws nog tot 2027 domineren. Een portret.",
"language": "nl",
"source": "De Standaard, 2022-09-24",
"challenges": ["foreign name"],
"critical_phrases": ["Xi Jinping"]
},
{
"text": "Het drijvende restaurant Jumbo kreeg zaterdag af te rekenen met ‘ongunstige omstandigheden’ toen het de Paraceleilanden passeerde in de Zuid-Chinese Zee.",
"language":"nl",
"source": "De Standaard, 2022-06-21",
"challenges": ["foreign name", "Small organization", "boundary detection"],
"critical_phrases": ["Jumbo", "Paraceleilanden", "Zuid-Chinese Zee"]
},
{
"text": "Diese @handelsblatt Meldung gibt sehr zu denken … einzig positiver Aspekt ist, dass 🇩🇪 & 🇪🇺 von der #NordStream1 Pipeline nicht mehr abhängig sind.",
"language":"de",
"source": "@Klaus_Mueller (Twitter), 2022-09-26",
"challenges": ["account mention", "emoji", "NE in hashtag"],
"critical_phrases": ["@handelsblatt", "🇩🇪", "🇪🇺", "#NordStream1"]
},
{
"text": "This @handelsblatt gives much to think about … the only positive aspect is that 🇩🇪 & 🇪🇺 are no longer dependend on the #NordStream1 pipeline.",
"language":"en",
"source": "@Klaus_Mueller (Twitter, translated), 2022-09-26",
"challenges": ["account mention", "emoji", "NE in hashtag"],
"critical_phrases": ["@handelsblatt", "🇩🇪", "🇪🇺", "#NordStream1"]
},
{
"text": "In addition, 28 industry-leading companies, including America Online, Inc., Apple Computer, Inc., Architext Software, Attachmate Corporation, AT&T, Borland International, Brio Technology, Inc., Computer Associates, Inc., Digital Equipment Corporation, Hewlett-Packard Company, Iconovex Corporation, Illustra Information Technologies, Inc., Informix Software, Inc., Intuit, Inc., Macromedia, Metrowerks, Inc., Novell, Inc., Oracle Corporation, Paper Software, Inc., Precept Software, Inc., RAD Technologies, Inc., The Santa Cruz Operation, Inc., Silicon Graphics, Inc., Spider Technologies, Sybase, Inc., Toshiba Corporation, Verity, Inc., and Vermeer Technologies, Inc., have endorsed JavaScript as an open standard object scripting language and intend to provide it in future products.",
"language": "en",
"source": "Netscape and Sun Announce JavaScript (1995). https://www.tech-insider.org/java/research/1995/1204.html",
"challenges": ["long list of organizations"],
"critical_phrases": ["America Online, Inc.", "Apple Computer, Inc.", "Architext Software", "Attachmate Corporation", "AT&T", "Borland International", "Brio Technology, Inc.", "Computer Associates, Inc.", "Digital Equipment Corporation", "Hewlett-Packard Company", "Iconovex Corporation", "Illustra Information Technologies, Inc.", "Informix Software, Inc.", "Intuit, Inc.", "Macromedia", "Metrowerks, Inc.", "Novell, Inc.", "Oracle Corporation", "Paper Software, Inc.", "Precept Software, Inc.", "RAD Technologies, Inc.", "The Santa Cruz Operation, Inc.", "Silicon Graphics, Inc.", "Spider Technologies", "Sybase, Inc.", "Toshiba Corporation", "Verity, Inc.", "Vermeer Technologies, Inc."]
}
]