Giter Site home page Giter Site logo

hemin1003 / java-spider Goto Github PK

View Code? Open in Web Editor NEW
336.0 22.0 150.0 14.78 MB

一个基于webmagic框架二次开发的java爬虫框架实战，已实现能爬取腾讯，搜狐，今日头条（单独集成功能）等资讯内容，配合elasticsearch框架用法，实现了自动爬虫，已投入线上生产使用。

JavaScript 14.63% Java 85.37%
spider scraper webmagic elasticsearch

java-spider's People

Contributors

hemin1003 avatar

Stargazers

avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar

Watchers

avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar

Forkers

yuanye09 xrogzu 51ma hellozhu donaldjohn zhaoshihua songfang cc8848 conalgorithm zouy1222 banana513a kuanghe12 loverqi crashiers w565152 lifeself chaiph tianchaoli yuanmuyi zhouzhonghui rockzhu codesica zxf1864 zeroyou waveletgreen ssuhvs un-knower tomzhang wiseks spacegithub smileandrun chenlei65368 gcjscustom kashing1 zhanghong9301 galenzhang cnbillow dongtianqi1125 ly774508966 cj506817364 smileclound lui1798 xiongtyl maxiaoxifeng dpcc2017 lisee ohmylawer weieast montagefan wangbk1997 kaintao junbai2018 genjiluo yue818 haitangshe www805 kandyjam ck-coffee jiyulongxu vokie123456 pingzilao hhy5277 zuiqingxingderen jackjet olddoor tyronerenekton cnopens jettangtzj gkuanine weilyken chenyueteng yhtsnda code4curiosity asdbaihu zhwniceshoot fpgz6 kingking888 xiehqing xzyterry liukingjia didiao11300 wenzhenxing mf1389004071 luckyleolee kilsoul sqqlyd alanlonglong newbeetree godlikedad fight1988 zhaotianen svnware sunbin728 howellyan shellposhy 1542196732 sidaofeng 251538232 loong2018 chandgaochengdong

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.