Skip to content

Latest commit

 

History

History
128 lines (88 loc) · 5.74 KB

datasources.md

File metadata and controls

128 lines (88 loc) · 5.74 KB

Data Sources Evaluated

Following is a list of the different data sources evaluated for the scrape as well as the features that are easy to obtain from the site.

Equipment

Sources

The sources are described in the below:

Source Description Requests per scrape
BackMarket Supplier of refurbished technological products. Very detailed information and easy to access. One per result item.
Printerland Printing equipment supplier. One per results page.
Broadbandchoices Price comparison site for broadband services. They have a specific section for mobile broadband dongles. One per results page.
Currys Retailer of new technological products. Very detailed information. One per result item.
ValuComputers Computer retailer. Detailed information. One per result item.
TabletMonkeys Tablet price comparison site. Detailed information. One per results page.
ONS Office for National Statistics. Very detailed and reliable information. Single

Note: All of the sources, except for the ONS data need to be aggregated in the database. The ONS data has been preaggregated by the ONS to mean and median calculations. In this project, we use the mean value because it's available for more regions and job roles that the median.


1. Laptop

Source Brand Model Processor Memory (RAM) HDD Release Year Screen Size OS
BackMarket ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
Curry's ✅ ✅ ✅ ✅ ✅ ✅ ✅
ValuComputers ✅ ✅ ✅ ✅ ✅ ✅ ✅

2. Mobile Broadband Dongles

Source Network Speed Price per month Data Allowance
Broadbandchoices* ✅ ✅ ✅

3. Desktop

Desktop computers are often sold without a screen, keyboard and mouse. We might need to scrape these elements separately and obtain an average price for them. Then we can add the average component prices to get an estimate for a desktop.


3.1 Desktop Computer

Source Brand Model Processor Memory (RAM) HDD Release Year OS
BackMarket ✅ ✅ ✅ ✅ ✅ ✅ ✅
Curry's ✅ ✅ ✅ ✅ ✅ ✅
Source 3 ✅ ✅
Source 4 ✅ ✅
Source 5

3.2 PC Monitor

Source Brand Model Screen Size
BackMarket ✅ ✅ ✅
Curry's ✅ ✅ ✅

5. Projector

Source Brand Model Resolution
Curry's ✅ ✅ ✅
Source 2 ✅ ✅ ✅

Not sure what these are:

  • "Min single-chip DLP
  • Min 2100 AL

6. Laser Printer

Source Brand Model DPI Print Resolution
Printerland ✅ ✅ ✅

7. Tablet

Source Brand Model Resolution Processor Screen Size Battery Life Release Year Storage
BackMarket ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅
Tabletmonkeys ✅ ✅ ✅ ✅ ✅ ✅ ✅ ✅

People and Employment and Skills

Source Description
ONS Office for National Statistics. Very detailed and representative information.

The following table shows the SOC code mappings for each of the resource type:

Category Codes
People - Management Time 1150, 113
People - Executive Time 111
Employment - Local Recruitment
Employment - Local Apprenticeship
Employment - Employment Scheme
Employment - Graduate Placement
Employment - Supporting local job fairs
Employment - Work experience placement for working age
Employment - Work experience placement for learning difficulties

Note: we use the mean value published by ONS rather than the median because it's available for more regions and job roles.

Space

Source Description
Regus Serviced office and meeting room space provicer accross the country.
Zipcube Serviced office and meeting room space listings page.