Giter Site home page Giter Site logo

douyin_crawl's Introduction

douyin_crawl

抖音视频批量爬取

开发工具 windows10

pycharm

编译环境

Python 3.8.6 (tags/v3.8.6:db45529, Sep 23 2020, 15:52:53) [MSC v.1927 64 bit (AMD64)] on win32
Type "help", "copyright", "credits" or "license" for more information.

简介

系统需要安装node环境(https://nodejs.org/)

pip install PyExecJS (python调用js)
pip install requests  (同步http客户端)
pip install aiohttp (异步http客户端)

使用说明

获取cookie方式
登录网页版抖音,F12网页调试,任意找到一个请求包中的cookie信息(很长一串),并粘贴至config.ini
CrawlHome是批量爬取个人主页所有视频和图片的启动程序
根据终端提示进行操作.爬取的视频放在项目目录的的文件夹下
用户主页链接示例(支持模糊),以下两种链接均支持

1.分享格式
长按复制此条消息,打开抖音搜索,查看TA的更多作品。 https://v.douyin.com/iJLb8V4y/

2.电脑端的浏览器url
https://www.douyin.com/user/MS4wLjABAAAAK8yyhMzdNAtyWqupVvVBXB_4bmr6DMAZ0zpGn91qlJU?vid=7124859220079561995
https://www.douyin.com/user/MS4wLjABAAAAK8yyhMzdNAtyWqupVvVBXB_4bmr6DMAZ0zpGn91qlJU

其他疑问请加qq1406823510

douyin_crawl's People

Contributors

zouzanyan avatar isolandone avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.