Skip to content

Releases: iofu728/spider

🏎iofu728/[email protected]

06 Jun 06:33
Compare
Choose a tag to compare

🚀 Enhancement

  1. Structure the basic_req and proxy_req API which have better scalability.
  2. auto-build db eniverment.
  3. refactor proxy code
  4. refactor bilibili code, which split to three module, basicBilibili, loginBilibili, upBilibili
  5. increase average GPA calculate.
  6. refactor blog/titleview, brushclass/brushclass, buildmd/activateArticle code

🏷 Pull Request: 4

#30 🍩Spider v4.0.0-alpha1
#31 🕌 change the modified time
#32 🚠 Change Av -> Bv
#34 🏎 version 3.3.0

👤 Committers: 1
Gunjianpan(@iofu728 )

🐔iofu728/[email protected]

10 Aug 09:43
Compare
Choose a tag to compare

🚀 Enhancement

  • 👹fast load configure
  • 🍯zimuzu configure
  • add OceanBall v2 decoder
  • support keyword re
  • add proxy explain
  • add view abnormal judge
  • Mafengwo js decoder
  • ctrip hotel detail js decoder
  • update some common function
  • proxies 4.0
  • API update of basic_req & proy_req
  • douban spider(movie info, user info, comment info)
  • 🐪66ip
  • 🦃update document
  • finish OceanBall v2 decode
  • 🐥About Bilibili (12 commit)
    1. Support history analysis.
    2. Auto-update history analysis data.
    3. add clean CSV script
    4. fix bilibili API change (about comment)
    5. reduce the frequency request sending.
    6. add a max time limit of bsocket.
  • 🦆About Proxy
    1. Update proxy process.

🐛 Bug Fix

  • 🙈fix zhihu view
  • 🙊fix memory bigbang
  • 🎫fix no rank email bug
  • fix star check
  • fix no comment check
  • 👹 fix ctrip hotel Detail
  • 🙈fix time

🏷 Pull Request: 9

#18 👹fast load configure
#19 🎫fix no rank email bug
#20 🏋prepare for version 4.0
#21 👹 fix ctrip hotel Detail
#23 🏌prepare for 3.2
#24 🦆prepare v3.2
#25 🙈fix time
#27 🐕prepare for version 3.2.0
#28 🐔update modified time

👤 Committers: 1
Gunjianpan(@iofu728 )

🐕 iofu728/[email protected]

09 Apr 03:04
Compare
Choose a tag to compare

🚀 Enhancement

  • add star crontab
  • proxy time_str
  • support keyword re
  • add proxy explain
  • add view abnormal judge

🐛 Bug Fix

  • fix email check os
  • fix star num error
  • fix no rank judge
  • fix read the gather proxy bug

🏷 Pull Request: 3
#15 👹fix no rank judge
#16 🐤fix some bug for v3.0
#17 🦃pre_version3.1

👤 Committers: 1
Gunjianpan(@iofu728 )

👾iofu728/[email protected]

06 Apr 14:16
Compare
Choose a tag to compare

🚀 Enhancement

  • Out of the box
  • Support utf-8

🐛 Bug Fix

  • Optimize bilibili/bsocket.py

🏷 Pull Request: 2
#13 🌈 prepare for v3.0 configure
#14 👾version3.0

👤 Committers: 1
Gunjianpan(@iofu728 )

👘 iofu728/[email protected]

05 Apr 02:52
Compare
Choose a tag to compare

🚀 Enhancement

  • proxy pool common Api
  • req basic Api
  • gather proxy autoload
  • some application
    • news(google & baidu)
    • youdao Note
    • alibaba
    • alimama
    • brush pku class
    • zhihu & csdn & jianshu
    • zimuzu
    • bilibili(http & websocket)
    • eastmoney
    • shaoq
  • support websocket

🐛 Bug Fix

🏷 Pull Request: 7
#6 🎅change readme
#7 🐷update spider
#8 🎅blog backend
#9 🎅blog backend
#10 😏 auto load gather
#11 😏 update new applicaton
#12 🌈 prepare for v3.0

👤 Committers: 1
Gunjianpan(@iofu728 )

🗂 iofu728/[email protected]

19 Nov 03:17
Compare
Choose a tag to compare

🚀 Enhancement

  • Uneven Pressure Distribution System

🐛 Bug Fix

  • fix some netease db bug

🏷 Pull Request: 1
#5 📟 Press Demo

👤 Committers: 1
Gunjianpan(@iofu728 )