Support redirects instead of throwing a "HTTP 302 error"

[umeshkalia]

node app.js is generating HTTP 302 error while accessing definition pages of my website e.g. http://www.alleydog.com/glossary/definition.php?term=Eccentricity
Other pages are being crawled successfully.
Can you please suggest some solution?

[nitriques]

Right now, redirects are not supported, so I would recommend to update your sitemap and make sure that all listed urls returns 200. But I'll keep this issue open since we should support 302/301 http statuses (but only on the same origin).

[nitriques]

We started to work on supporting redirects: a113ba2

[nitriques]

Also added a relevant commit to this problem: a19af58

[wortkotze]

I would need this feature also, is it already in the latest release on npm? thx Stephan

[nitriques]

@wortkotze Sadly, it is still not done. But, it should be pretty easy to add now...

[wortkotze]

@nitriques thx I used your commit and added it manually

[nitriques]

@wortkotze That's cool! Wanna send a PR !?!?