spider icon indicating copy to clipboard operation
spider copied to clipboard

现在的代码去爬,取到的是假数据了,我也研究下

Open alexmay21 opened this issue 6 years ago • 4 comments

alexmay21 avatar May 20 '19 09:05 alexmay21

Getting ctrip hotel detail need login status. Up to now, I finish some cookie field generation, like 'htlstmp', 'htltmp',

And you also can refer to this cookie analysis table.

This code only can use when you copy the cookie to local.

I will do more work about the cookie analysis after my recent work. 👻

PS: don't care about the user action collect request, It not the necessary though I have finished this.

iofu728 avatar May 21 '19 03:05 iofu728

Ctrip oceanball content has changed, and automatic controller such as selenium can be identified. It's hard to get real data.

wojiaohuhu avatar Jun 07 '19 16:06 wojiaohuhu

Ctrip oceanball content has changed, and an automatic controller such as selenium can be identified. It's hard to get real data.

The dynamic OceanBall have been parsing in https://github.com/iofu728/spider/blob/master/ctrip/hotelDetail.py#L148.

It's import to structure cookie rather than parsing oceanball.

And up to now, I finish some cookie field generation, like 'htlstmp', 'htltmp'.

Sorry, delay solving this problem for a long time.

iofu728 avatar Jun 07 '19 17:06 iofu728

The encoder script of OceanBall has changed, respectively, at the beginning of June and July.

And I have finished the work of decoder oceanball v2 script. But I still can't get the current result.

Now, I pubic the decoder code of OceanBall v2, Maybe It's useful for you.

Best wish!

iofu728 avatar Aug 10 '19 09:08 iofu728