renyijiu / douyin_downloader Goto Github PK
View Code? Open in Web Editor NEW👏Download all douyin videos of user(including favorites) , 下载指定用户的所有抖音视频以及收藏的视频(无水印)
License: MIT License
👏Download all douyin videos of user(including favorites) , 下载指定用户的所有抖音视频以及收藏的视频(无水印)
License: MIT License
I only got response: get empty list, {'has_more': 0, 'status_code': 0, 'aweme_list': []}
这个人的主页第一条视频就是这样
http://v.douyin.com/Pqgn6Q/
视频是这个
http://v.douyin.com/Pqbf7r/
原视频有几分钟,下载的只有18秒
why i got itemId = 0 and, uid =0, i get douyin link in vietnam
here the link:
我在里面添加了链接,但是下载的时候什么都没有
通过分享链接,如何能做到去水印呢?我看渲染出来的video标签内的链接并没有水印的参数,是在那步修改的url呢?
get empty list, {'has_more': 1, 'status_code': 0, 'min_cursor': 0, 'aweme_list': []}
retry...
get empty list, {'has_more': 0, 'status_code': 0, 'aweme_list': []}
retry...
get empty list, {'has_more': 0, 'status_code': 0, 'aweme_list': []}
retry...
get empty list, {'has_more': 0, 'status_code': 0, 'aweme_list': []}
retry...
get empty list, {'has_more': 0, 'status_code': 0, 'aweme_list': []}
retry...
get empty list, {'has_more': 0, 'status_code': 0, 'aweme_list': []}
retry...
get empty list, {'has_more': 0, 'status_code': 0, 'aweme_list': []}
retry...
get empty list, {'has_more': 0, 'status_code': 0, 'aweme_list': []}
retry...
get empty list, {'has_more': 0, 'status_code': 0, 'aweme_list': []}
retry...
get empty list, {'has_more': 0, 'status_code': 0, 'aweme_list': []}
retry...
get empty list, {'has_more': 0, 'status_code': 0, 'aweme_list': []}
retry...
Traceback (most recent call last):
File "douyin.py", line 539, in
CrawlerScheduler(content, favorite)
File "douyin.py", line 341, in init
self.scheduling(favorite)
File "douyin.py", line 350, in scheduling
self.download_user_videos(user_id, favorite)
File "douyin.py", line 368, in download_user_videos
self.push_download_job(uid, dytk, 0, favorite)
File "douyin.py", line 379, in push_download_job
list_json = get_list_by_uid(user_id, dytk, cursor, favorite)
File "douyin.py", line 116, in get_list_by_uid
res_json = json.loads(r.html.text)
File "/usr/lib64/python3.6/json/init.py", line 354, in loads
return _default_decoder.decode(s)
File "/usr/lib64/python3.6/json/decoder.py", line 339, in decode
obj, end = self.raw_decode(s, idx=_w(s, 0).end())
File "/usr/lib64/python3.6/json/decoder.py", line 357, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
Traceback (most recent call last):
File "douyin.py", line 539, in
CrawlerScheduler(content, favorite)
File "douyin.py", line 341, in init
self.scheduling(favorite)
File "douyin.py", line 350, in scheduling
self.download_user_videos(user_id, favorite)
File "douyin.py", line 368, in download_user_videos
self.push_download_job(uid, dytk, 0, favorite)
File "douyin.py", line 379, in push_download_job
list_json = get_list_by_uid(user_id, dytk, cursor, favorite)
File "douyin.py", line 95, in get_list_by_uid
signature = FREEZE_SIGNATURE if FREEZE_SIGNATURE else get_signature(user_id)
File "douyin.py", line 70, in get_signature
r.html.render()
File "D:\Python\Python36\lib\site-packages\requests_html.py", line 654, in html
self._html = HTML(session=self.session, url=self.url, html=self.content, default_encoding=self.encoding)
File "D:\Python\Python36\lib\site-packages\requests_html.py", line 421, in init
element=PyQuery(html)('html') or PyQuery(f'{html}')('html'),
File "D:\Python\Python36\lib\site-packages\pyquery\pyquery.py", line 266, in init
raise TypeError(context)
TypeError: None
他提到的requests_html和pyquery我重新卸载安装过,问题依旧,是哪出问题了?
Traceback (most recent call last):
File "douyin.py", line 11, in
from requests_html import HTMLSession
File "C:\Python\lib\site-packages\requests_html.py", line 9, in
import pyppeteer
File "C:\Python\lib\site-packages\pyppeteer_init_.py", line 30, in
from pyppeteer.launcher import connect, launch, executablePath # noqa: E402
File "C:\Python\lib\site-packages\pyppeteer\launcher.py", line 24, in
from pyppeteer.browser import Browser
File "C:\Python\lib\site-packages\pyppeteer\browser.py", line 13, in
from pyppeteer.connection import Connection
File "C:\Python\lib\site-packages\pyppeteer\connection.py", line 12, in
import websockets
File "C:\Python\lib\site-packages\websockets_init_.py", line 3, in
from .auth import *
File "C:\Python\lib\site-packages\websockets\auth.py", line 15, in
from .server import HTTPResponse, WebSocketServerProtocol
File "C:\Python\lib\site-packages\websockets\server.py", line 49, in
from .protocol import WebSocketCommonProtocol
File "C:\Python\lib\site-packages\websockets\protocol.py", line 18, in
from typing import (
ImportError: cannot import name 'Deque'
When I use the scripts python douyin.py --url=https://v.douyin.com/JRoydED/, I jsut encountered the problem following
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='storage.googleapis.com', port=443): Max retries exceeded with url: /chromium-browser-snapshots/Mac/575458/chrome-mac.zip (Caused by SSLError(SSLError("bad handshake: Error([('SSL routines', 'tls_process_server_certificate', 'certificate verify failed')])"))). I don't know how to solve it.
Traceback (most recent call last):
File "douyin.py", line 574, in
CrawlerScheduler(content, favorite)
File "douyin.py", line 370, in init
self.scheduling(favorite)
File "douyin.py", line 379, in scheduling
self.download_user_videos(user_id, favorite)
File "douyin.py", line 396, in download_user_videos
uid, dytk = get_user_info(user_id)
File "douyin.py", line 78, in get_user_info
uid = r.html.search('uid: "{uid}"')['uid']
TypeError: 'NoneType' object is not subscriptable
(douyin_env) F:\工作 2\一>python douyin.py --urls="http://v.douyin.com/moUEXM/"
Traceback (most recent call last):
File "douyin.py", line 539, in
CrawlerScheduler(content, favorite)
File "douyin.py", line 341, in init
self.scheduling(favorite)
File "douyin.py", line 350, in scheduling
self.download_user_videos(user_id, favorite)
File "douyin.py", line 368, in download_user_videos
self.push_download_job(uid, dytk, 0, favorite)
File "douyin.py", line 379, in push_download_job
list_json = get_list_by_uid(user_id, dytk, cursor, favorite)
File "douyin.py", line 95, in get_list_by_uid
signature = FREEZE_SIGNATURE if FREEZE_SIGNATURE else get_signature(user_id)
File "douyin.py", line 70, in get_signature
r.html.render()
File "F:\工作 2\一\douyin_env\lib\site-packages\requests_html.py", line 654, in html
self._html = HTML(session=self.session, url=self.url, html=self.content, default_encoding=self.encoding)
File "F:\工作 2\一\douyin_env\lib\site-packages\requests_html.py", line 421, in init
element=PyQuery(html)('html') or PyQuery(f'{html}')('html'),
File "F:\工作 2一\douyin_env\lib\site-packages\pyquery\pyquery.py", line 266, in init
raise TypeError(context)
TypeError: None
不知道写的啥,不认真。 看不懂是我水平低了
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.