Job data validation with Indeed website

[samshipengs]

I'm trying to validate the (indeed) data I got from JobSpy with the job listings I see directly from Indeed website, given same search params,

such as:

• radius 50km
• same location
• same job title
• within last 24hrs

1. I'm seeing some records that show date_posted for example 10 days old (see attachment), but when I go to indeed and search within last 24hrs, it shows up as well, which means shouldn't that listing have date_posted like either Dec 23 (today) or Dec 22? instead of Dec 18?

2. In general is this a robust way to validate the data we get from JobSpy simply by looking up against the Indeed website, or there might be some discrepancies due to non-obvious things?

3. I took a quick look of the code, and found this line:

f'location: {{where: "{self.scraper_input.location}", radius: {self.scraper_input.distance}, radiusUnit: MILES}}'

I'm searching the ca website, which would default me to km for radius, so for validation purposes, I suppose I should set the unit to be something KMS instead of MILES?

thanks!