Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

现在的代码去爬,取到的是假数据了,我也研究下 #26

Open
alexmay21 opened this issue May 20, 2019 · 4 comments
Open
Assignees
Labels
enhancement New feature or request feature some feature will be develop

Comments

@alexmay21
Copy link

No description provided.

@iofu728
Copy link
Owner

iofu728 commented May 21, 2019

Getting ctrip hotel detail need login status.
Up to now, I finish some cookie field generation, like 'htlstmp', 'htltmp',

And you also can refer to this cookie analysis table.

This code only can use when you copy the cookie to local.

I will do more work about the cookie analysis after my recent work. 👻

PS: don't care about the user action collect request, It not the necessary though I have finished this.

@iofu728 iofu728 self-assigned this May 21, 2019
@iofu728 iofu728 added enhancement New feature or request feature some feature will be develop labels May 21, 2019
@wojiaohuhu
Copy link

Ctrip oceanball content has changed, and automatic controller such as selenium can be identified.
It's hard to get real data.

@iofu728
Copy link
Owner

iofu728 commented Jun 7, 2019

Ctrip oceanball content has changed, and an automatic controller such as selenium can be identified.
It's hard to get real data.

The dynamic OceanBall have been parsing in https://github.com/iofu728/spider/blob/master/ctrip/hotelDetail.py#L148.

It's import to structure cookie rather than parsing oceanball.

And up to now, I finish some cookie field generation, like 'htlstmp', 'htltmp'.

Sorry, delay solving this problem for a long time.

@iofu728
Copy link
Owner

iofu728 commented Aug 10, 2019

The encoder script of OceanBall has changed, respectively, at the beginning of June and July.

And I have finished the work of decoder oceanball v2 script. But I still can't get the current result.

Now, I pubic the decoder code of OceanBall v2, Maybe It's useful for you.

Best wish!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request feature some feature will be develop
Projects
None yet
Development

No branches or pull requests

3 participants