Giter Site home page Giter Site logo

auto-android-crawler-example's Introduction

前言

这只是一个案例,安卓版Boss直聘APP自动化浏览。

可获取的信息包括

  • 职位
  • 薪资
  • 工作地点
  • 经验要求/学历要求
  • 职位要求详情页的全部信息
  • 工作相关标签
  • 公司名
  • 公司详情
  • 职位要求详情页链接。

该项目涉及以下知识

网络通畅的情况下,速率为:[4s~6s]/篇。

经测试1s/篇的速率特别容易被封,账号有限,不推荐太高速率。

由于其岗位只能选特定地区,因此建议以多进程配合多账号的形式进行信息聚合。

使用方法

测试用的是小米8 Lite,环境为Windows,IDE为Pycharm.

APP先手动登录一次。

先看看→Android Debug Bridge(adb)教程←→Appium自动化测试←

PC端与手机端连接同一网络,该方法容易device offline,推荐用USB连接。

手动替换more.png, 修改config.py中的个别变量

  • capabilities变量 - platformVersion改为你的手机的安卓版本
  • adb变量
    • WIFI连接 - 将192.168.55.153:5555改为你手机的ip地址:5555
    • USB数据线连接 - 通过cmd输入adb devices出现的值中devies前面的字段

main.py为主入口,直接Run就行了。

留言

爬取一定量时(大概在70条左右),该app会采取反制措施,强制隐藏UI元素。

解决方法就是不用Appium,直接用adb + python + OCR的方式,但是OCR识别文字后,还要考虑文字输出格式/段落/属于哪部分等问题,该逻辑部分需手动实现。

auto-android-crawler-example's People

Contributors

reversesacle avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.