actually look at robots.txt ... #5

Open

Labels

opened

Yea, I need to do this so 1. i'm not being a jerk, and 2. I don't have to download as much stuff :D.

Metadata

Assignees

No one assigned

Labels

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests