features.md

Features

Document features

Feature No.	Description
1	Stage0 score from TREC input file
2	BM25 Atire for the document
3	BM25 Atire for the document body
4	BM25 Atire for the document title
5	BM25 Atire for the document headings (h1-h4)
6	BM25 Atire for document inlinks
7	BM25 Atire for document a tags
8	BM25 TREC 3 (k = 1.2) for the document
9	BM25 TREC 3 (k = 1.2) for the document body
10	BM25 TREC 3 (k = 1.2) for the document title
11	BM25 TREC 3 (k = 1.2) for the document headings (h1-h4)
12	BM25 TREC 3 (k = 1.2) for the document inlinks
13	BM25 TREC 3 (k = 1.2) for the document a tags
14	BM25 TREC 3 (k = 2.0) for the document
15	BM25 TREC 3 (k = 2.0) for the document body
16	BM25 TREC 3 (k = 2.0) for the document title
17	BM25 TREC 3 (k = 2.0) for the document headings (h1-h4)
18	BM25 TREC 3 (k = 2.0) for the document inlinks
19	BM25 TREC 3 (k = 2.0) for the document a tags
20	LMDS (mu = 2500) for the document
21	LMDS (mu = 2500) for the document body
22	LMDS (mu = 2500) for the document title
23	LMDS (mu = 2500) for the document headings (h1-h4)
24	LMDS (mu = 2500) for the document inlinks
25	LMDS (mu = 2500) for the document a tags
26	LMDS (mu = 1500) for the document
27	LMDS (mu = 1500) for the document body
28	LMDS (mu = 1500) for the document title
29	LMDS (mu = 1500) for the document headings (h1-h4)
30	LMDS (mu = 1500) for the document inlinks
31	LMDS (mu = 1500) for the document a tags
32	LMDS (mu = 1000) for the document
33	LMDS (mu = 1000) for the document body
34	LMDS (mu = 1000) for the document title
35	LMDS (mu = 1000) for the document headings (h1-h4)
36	LMDS (mu = 1000) for the document inlinks
37	LMDS (mu = 1000) for the document a tags
38	TF.IDF for the document
39	TF.IDF for the document body
40	TF.IDF for the document title
41	TF.IDF for the document headings (h1-h4)
42	TF.IDF for the document inlinks
43	TF.IDF for the document a tags
44	Probability score for the document
45	Probability score for the document body
46	Probability score for the document title
47	Probability score for the document headings (h1-h4)
48	Probability score for the document inlinks
49	Probability score for the document a tags
50	Bose-Einstein score for the document
51	Bose-Einstein score for the document body
52	Bose-Einstein score for the document title
53	Bose-Einstein score for the document headings (h1-h4)
54	Bose-Einstein score for the document inlinks
55	Bose-Einstein score for the document a tags
56	DPH score for the document
57	DPH score for the document body
58	DPH score for the document title
59	DPH score for the document headings (h1-h4)
60	DPH score for the document inlinks
61	DPH score for the document a tags
62	DFR score for the document
63	DFR score for the document body
64	DFR score for the document title
65	DFR score for the document headings (h1-h4)
66	DFR score for the document inlinks
67	DFR score for the document a tags
68	Raw stream length of document
69	Raw stream length of document body
70	Raw stream length of document title
71	Raw stream length of document headings (h1-h4)
72	Raw stream length of document inlinks
73	Raw stream length of document a tags
74	Term frequency normalized sum of stream length of document
75	Term frequency normalized sum of stream length of document body
76	Term frequency normalized sum of stream length of document title
77	Term frequency normalized sum of stream length of document headings (h1-h4)
78	Term frequency normalized sum of stream length of document inlinks
79	Term frequency normalized sum of stream length of document a tags
80	Term frequency normalized min of stream length of document
81	Term frequency normalized min of stream length of document body
82	Term frequency normalized min of stream length of document title
83	Term frequency normalized min of stream length of document headings (h1-h4)
84	Term frequency normalized min of stream length of document inlinks
85	Term frequency normalized min of stream length of document a tags
86	Term frequency normalized max of stream length of document
87	Term frequency normalized max of stream length of document body
88	Term frequency normalized max of stream length of document title
89	Term frequency normalized max of stream length of document headings (h1-h4)
90	Term frequency normalized max of stream length of document inlinks
91	Term frequency normalized max of stream length of document a tags
92	Term frequency normalized mean of stream length of document
93	Term frequency normalized mean of stream length of document body
94	Term frequency normalized mean of stream length of document title
95	Term frequency normalized mean of stream length of document headings (h1-h4)
96	Term frequency normalized mean of stream length of document inlinks
97	Term frequency normalized mean of stream length of document a tags
98	Term frequency normalized variance of stream length of document
99	Term frequency normalized variance of stream length of document body
100	Term frequency normalized variance of stream length of document title
101	Term frequency normalized variance of stream length of document headings (h1-h4)
102	Term frequency normalized variance of stream length of document inlinks
103	Term frequency normalized variance of stream length of document a tags
104	TP-Score of document
105	Sum of BM25 query bigrams within an unordered window of 8 of the document
106	BM25 bigram interval score within a window of 100 of the document
107	Frequency of query terms within the document title
108	Frequency of query terms within the document headings (h1-h4)
109	Frequency of query terms within the document
110	Frequency of query terms within the document inlinks
111	Document tag count for title
112	Document tag count for headings (h1-h4)
113	Document tag count for applet
114	Document tag count for object
115	Document tag count for embed
116	Number of slashes in URL
117	URL length

Static document features

Feature No.	Description
116	Document length
117	Title length
118	Visible term length
119	URL length
120	URL depth
121	Average term length
122	Entropy
123	Stop cover
124	Stop ratio
125	Fraction of anchor text
126	Fraction of visible text
127	Fraction of table text
128	Fraction of td text

Unigram pre-retrieval features

Feature No.	Description
129	Mean collection document frequency of query terms
130	Mean geometric mean of query terms
131	Min collection document frequency (query term)
132	Max collection document frequency (query term)
133	Min geometric mean (query term)
134	Max geometric mean (query term)
135	BM25 mean impact
136	BM25 mean mean
137	BM25 mean harmonic mean
138	BM25 mean median
139	BM25 mean interquartile range
140	BM25 mean variance
141	BM25 min
142	BM25 max
143	BM25 min mean
144	BM25 max mean
145	BM25 min median
146	BM25 max median
147	BM25 min harmonic mean
148	BM25 max harmonic mean
149	BM25 min variance
150	BM25 max variance
151	BM25 min first quartile
152	BM25 max first quartile
153	BM25 min third quartile
154	BM25 max third quartile
155	TF.IDF mean impact
156	TF.IDF mean mean
157	TF.IDF mean harmonic mean
158	TF.IDF mean median
159	TF.IDF mean interquartile range
160	TF.IDF mean variance
161	TF.IDF min
162	TF.IDF max
163	TF.IDF min mean
164	TF.IDF max mean
165	TF.IDF min median
166	TF.IDF max median
167	TF.IDF min harmonic mean
168	TF.IDF max harmonic mean
169	TF.IDF min variance
170	TF.IDF max variance
171	TF.IDF min first quartile
172	TF.IDF max first quartile
173	TF.IDF min third quartile
174	TF.IDF max third quartile
175	LM mean impact
176	LM mean mean
177	LM mean harmonic mean
178	LM mean median
179	LM mean interquartile range
180	LM mean variance
181	LM min
182	LM max
183	LM min mean
184	LM max mean
185	LM min median
186	LM max median
187	LM min harmonic mean
188	LM max harmonic mean
189	LM min variance
190	LM max variance
191	LM min first quartile
192	LM max first quartile
193	LM min third quartile
194	LM max third quartile
195	PR mean impact
196	PR mean mean
197	PR mean harmonic mean
198	PR mean median
199	PR mean interquartile range
200	PR mean variance
201	PR min
202	PR max
203	PR min mean
204	PR max mean
205	PR min median
206	PR max median
207	PR min harmonic mean
208	PR max harmonic mean
209	PR min variance
210	PR max variance
211	PR min first quartile
212	PR max first quartile
213	PR min third quartile
214	PR max third quartile
215	BE mean impact
216	BE mean mean
217	BE mean harmonic mean
218	BE mean median
219	BE mean interquartile range
220	BE mean variance
221	BE min
222	BE max
223	BE min mean
224	BE max mean
225	BE min median
226	BE max median
227	BE min harmonic mean
228	BE max harmonic mean
229	BE min variance
230	BE max variance
231	BE min first quartile
232	BE max first quartile
233	BE min third quartile
234	BE max third quartile
235	DPH mean impact
236	DPH mean mean
237	DPH mean harmonic mean
238	DPH mean median
239	DPH mean interquartile range
240	DPH mean variance
241	DPH min
242	DPH max
243	DPH min mean
244	DPH max mean
245	DPH min median
246	DPH max median
247	DPH min harmonic mean
248	DPH max harmonic mean
249	DPH min variance
250	DPH max variance
251	DPH min first quartile
252	DPH max first quartile
253	DPH min third quartile
254	DPH max third quartile
255	DFR mean impact
256	DFR mean mean
257	DFR mean harmonic mean
258	DFR mean median
259	DFR mean interquartile range
260	DFR mean variance
261	DFR min
262	DFR max
263	DFR min mean
264	DFR max mean
265	DFR min median
266	DFR max median
267	DFR min harmonic mean
268	DFR max harmonic mean
269	DFR min variance
270	DFR max variance
271	DFR min first quartile
272	DFR max first quartile
273	DFR min third quartile
274	DFR max third quartile

Query features

Feature No.	Description
275	Query length
276	Query length non-stop words
277	Simplified clarity score
278	Query scope score
279	TF.IDF average
280	TF.IDF variance
281	TF.IDF standard deviation
282	TF.IDF confidence
283	Gamma2: IDF max / IDF min
284	Average IDF on full query
285	Average IDF non-stop words
286	Average ICTF on full query
287	Average ICTF non-stop words