Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

cant bypass this site #54

Open
thanh858036 opened this issue Jul 21, 2021 · 4 comments
Open

cant bypass this site #54

thanh858036 opened this issue Jul 21, 2021 · 4 comments

Comments

@thanh858036
Copy link

it dont bybass cloadflare on this site
https://bato.to/

error detail
{ "status": "ok", "message": "", "startTimestamp": 1626848183197, "endTimestamp": 1626848183575, "session": "d282ab10-e9ea-11eb-bea0-1b284ff0b0fb", "solution": { "url": "https://bato.to/", "status": 403, "headers": { "status": "403", "date": "Wed, 21 Jul 2021 06:16:23 GMT", "content-type": "text/plain; charset=UTF-8", "content-length": "16", "x-frame-options": "SAMEORIGIN", "cache-control": "private, max-age=0, no-store, no-cache, must-revalidate, post-check=0, pre-check=0", "expires": "Thu, 01 Jan 1970 00:00:01 GMT", "cf-request-id": "0b694e5c8200004ec7521f4000000001", "expect-ct": "max-age=604800, report-uri=\"https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct\"", "report-to": "{\"endpoints\":[{\"url\":\"https:\/\/a.nel.cloudflare.com\/report\/v3?s=uVAUOhtze1dS6YUzrURwYkkE%2Bwab6FEs%2FKD4JQaoHD8YyE8NyTDXzMi2RFPnQHG1wNW0A3MG78VJU02dPmfZob4NAJ9zVPHF2G9HdU1zFC6Zy0mo5GT8m4PmYWHWAQbLJwun9jw%3D\"}],\"group\":\"cf-nel\",\"max_age\":604800}", "nel": "{\"report_to\":\"cf-nel\",\"max_age\":604800}", "vary": "Accept-Encoding", "server": "cloudflare", "cf-ray": "67224cda6c454ec7-FRA", "alt-svc": "h3-27=\":443\"; ma=86400, h3-28=\":443\"; ma=86400, h3-29=\":443\"; ma=86400, h3=\":443\"; ma=86400" }, "response": "<html><head></head><body><pre style=\"word-wrap: break-word; white-space: pre-wrap;\">error code: 1005</pre></body></html>", "cookies": [], "userAgent": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_4) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.0 Safari/537.36" } }
i tried
{ "cmd": "request.get", "url":"https://bato.to", "session":"d282ab10-e9ea-11eb-bea0-1b284ff0b0fb", "userAgent": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_4) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.0 Safari/537.36", "maxTimeout": 60000 }
@Pyreaus
Copy link

Pyreaus commented Aug 2, 2021

I'm getting a similar error - Idk if NoahCardoza is continuing work on this

@serk7
Copy link
Contributor

serk7 commented Aug 15, 2021

error code: 1005 <-- cloudflare error (Access Denied)
"status": 403 <-- url status ( Forbidden)

Seems your ip is blacklisted on their site. Try using a proxy:

,"maxTimeout": 60000,"proxy":"proxy.xxxxxxxx.com:80"}"

@NoahCardoza
Copy link
Owner

@Pyreaus yeah, you are kinda right. I'd love to keep up my open source projects but unlike my job, they don't pay lol.

@jairoxyz
Copy link
Contributor

I updated the stealth module ("puppeteer-extra-plugin-stealth": "^2.7.8") and am getting good response from bato.to:

2021-08-23T14:35:40.902Z INFO REQ-3 Incoming request: POST /v1
2021-08-23T14:35:40.903Z INFO REQ-3 Params: {"cmd":"request.get","session":"test","url":"https://bato.to/","userAgent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.116 Safari/537.36","maxTimeout":10000}
2021-08-23T14:35:41.133Z DEBUG REQ-3 Using custom UA: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.116 Safari/537.36
2021-08-23T14:35:41.134Z DEBUG REQ-3 Adding custom headers: {}
2021-08-23T14:35:41.134Z DEBUG REQ-3 { headers: [Function (anonymous)] }
2021-08-23T14:35:41.136Z DEBUG REQ-3 Navigating to... https://bato.to/
2021-08-23T14:35:41.138Z DEBUG REQ-3 {
  headers: {
    'upgrade-insecure-requests': '1',
    'user-agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.116 Safari/537.36'
  }
}
2021-08-23T14:35:43.094Z INFO REQ-3 Cloudflare detected
2021-08-23T14:35:43.333Z INFO REQ-3 Successful response in 2.431 s

I have a problem, though, updating the other puppeteer modules to the latest versions. Getting typescript errors when doing npm run build:

src/session.ts:101:7 - error TS2740: Type 'Browser' is missing the following properties from type 'Browser': setMaxListeners, getMaxListeners, listeners, rawListeners, and 3 more.

101       browser,
          ~~~~~~~

  src/session.ts:17:3
    17   browser: Browser
         ~~~~~~~
    The expected type comes from property 'browser' which is declared here on type 'SessionsCacheItem'

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
5 participants
@jairoxyz @thanh858036 @NoahCardoza @serk7 @Pyreaus