langzifun / langsrccurise Goto Github PK
View Code? Open in Web Editor NEWSRC子域名资产监控
SRC子域名资产监控
入库的时候提示
] 错误代码 [43] (1406, "Data too long for column 'belong_domain' at row 1")
这个是由于域名太长嘛?
如何设置扫描周期,如每天扫一遍或没周扫一遍?
InternalError at /lsrc/app/other_url/
(1525, "Incorrect DATETIME value: '%www.kuaishou.com%'")
出现以下报错:
ModuleNotFoundError: No module named 'tinydb'
python3 manage.py inserturl input_subdomain.txt
执行过程很慢,然后执行完终端没有打印任何提示语句,数据展示、监控域名捕获数量中都没有新增子域名
我是重新部署新版本的,但是执行两条命令:1. python3 manage.py makemigrations 2. python3 manage.py migrate
还是不行
请问会有什么原因呢
python3 manage.py initial 后会有以下报错
UnicodeEncodeError: 'ascii' codec can't encode characters in position 1-6: ordinal not in range(128)
建议增加一个域名的分类查询,或者域名的分类不然所有域名都在一起了不方便查看
Traceback (most recent call last): File "manage.py", line 50, in <module> from core.Run_Tasks import start File "/LangSrcCurise/core/Run_Tasks.py", line 2, in <module> from .main import Sub_Crawl,Sub_Baidu,Sub_Brute,Run_Cpu_Min,Sub_ChangeIp,Sub_ChangeInf,Sub_Api,Heartbeat File "/LangSrcCurise/core/main.py", line 5, in <module> from core.Subdomain_Baidu import Baidu File "/LangSrcCurise/core/Subdomain_Baidu.py", line 37, in <module> Set = Setting.objects.all()[0] File "/usr/local/lib64/python3.6/site-packages/django/db/models/query.py", line 303, in __getitem__ return qs._result_cache[0] IndexError: list index out of range
资源消耗已经增加id到200+了,之前的id在列表里一直存在。这个资源消耗不会自动释放的吗,会一直累加?
可否手动删除,疑问,求解答~~
多谢大佬!
初始化子域名 : 打码.com
第1次请求失败....
第2次请求失败....
第3次请求失败....
第4次请求失败....
local variable 'r' referenced before assignment
as title
建议增加:数据展示中,基于日期的搜索。以便导出最近几天的所有搜集到的域名
请问更新要怎么更新,把代码直接覆盖可以不
File "/usr/local/lib/python3.8/dist-packages/django/db/models/query.py", line 303, in getitem
return qs._result_cache[0]
IndexError: list index out of range
Traceback (most recent call last):
File "manage.py", line 50, in
from core.Run_Tasks import start
File "/Users/xxx/Downloads/LangSrcCurise/core/Run_Tasks.py", line 2, in
from .main import Sub_Crawl,Sub_Baidu,Sub_Brute,Run_Cpu_Min,Sub_ChangeIp,Sub_ChangeInf,Sub_Api,Heartbeat
File "/Users/xxxx/Downloads/LangSrcCurise/core/main.py", line 5, in
from core.Subdomain_Baidu import Baidu
File "/Users/xxxx/Downloads/LangSrcCurise/core/Subdomain_Baidu.py", line 37, in
Set = Setting.objects.all()[0]
File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/django/db/models/query.py", line 303, in getitem
return qs._result_cache[0]
IndexError: list index out of range
Traceback (most recent call last):
File "manage.py", line 48, in
from core.Run_Tasks import start
File "/learn/python/LangSrcCurise/core/Run_Tasks.py", line 2, in
from .main import Sub_Crawl,Sub_Baidu,Sub_Brute,Run_Cpu_Min,Sub_ChangeIp,Sub_ChangeInf,Sub_Api,Heartbeat
File "/learn/python/LangSrcCurise/core/main.py", line 5, in
from core.Subdomain_Baidu import Baidu
File "/learn/python/LangSrcCurise/core/Subdomain_Baidu.py", line 28, in
Set = Setting.objects.all()[0]
File "/usr/local/lib/python3.7/site-packages/django/db/models/query.py", line 303, in getitem
return qs._result_cache[0]
IndexError: list index out of range
初始化子域名 : xxx.com
第1次请求失败....
第2次请求失败....
第3次请求失败....
第4次请求失败....
暂无数据 暂无数据 暂无数据
(1062, "Duplicate entry 'xxx.com' for key 'url'")
初始化子域名 : xxx.net
第1次请求失败....
第2次请求失败....
第3次请求失败....
第4次请求失败....
暂无数据 暂无数据 暂无数据
初始化的測試能傳郵件到指定郵箱, 但後續運行就沒有再傳郵件了, 也沒有報錯, 請問是哪邊出了問題?
Fatal Python error: Cannot recover from stack overflow.
Current thread 0x00001768 (most recent call first):
系统centos7,相关都已安装,貌似不启动捕获啊
运行python3 manage.py startscan 提示 killd正常吗?
Traceback (most recent call last):
File "manage.py", line 46, in
from initialize.initialdomains import initialdomains
File "/usr/local/lib/python3.6/site-packages/django/LangSrcCurise/initialize/initialdomains.py", line 12, in
from core.main import Add_Data_To_Url
File "/usr/local/lib/python3.6/site-packages/django/LangSrcCurise/core/main.py", line 5, in
from core.Subdomain_Baidu import Baidu
File "/usr/local/lib/python3.6/site-packages/django/LangSrcCurise/core/Subdomain_Baidu.py", line 37, in
Set = Setting.objects.all()[0]
File "/usr/local/lib/python3.6/site-packages/django/db/models/query.py", line 303, in getitem
return qs._result_cache[0]
IndexError: list index out of range
运行python3 manage.py scanstart也会报类似的No module的提示
安装的python.3.6.9、django2.1.10
求解[哭]
请问能否配置,每个域名监控的开关。如果想监控的域名太多,十几个的话。想新增一个域名进去,每次都要等之前旧域名先扫完,才开始扫新加入的域名,觉得好慢
!
执行:python3 manage.py startscan
错误代码 [19] 获取预扫描IP失败
Traceback (most recent call last):
File "manage.py", line 30, in
with co_mysql(db='mysql') as cursor:
File "/usr/local/python3/lib/python3.6/contextlib.py", line 81, in enter
return next(self.gen)
File "manage.py", line 21, in co_mysql
conn = pymysql.connect(host=host,user=username,password=password,port=port,db=db,charset='utf8')
File "/usr/local/python3/lib/python3.6/site-packages/pymysql/init.py", line 94, in Connect
return Connection(*args, **kwargs)
File "/usr/local/python3/lib/python3.6/site-packages/pymysql/connections.py", line 325, in init
self.connect()
File "/usr/local/python3/lib/python3.6/site-packages/pymysql/connections.py", line 630, in connect
raise exc
pymysql.err.OperationalError: (2003, "Can't connect to MySQL server on '127.0.0.1' ([Errno 111] Connection refused)")
登录mysql报错
ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/var/lib/mysql/mysql.sock' (111)
这个在哪里?
错误代码 [31] 获取预爬行网址失败,然后就一直提示这个信息!
在现有的子域名监控基础上,对一些三方间(Apache、Nginx、Weblogic)的漏洞更新站点进行直接监控,设置对应关键字进行匹配、命中即推送,是否就可以达成了 Nday 实时跟踪的效果呢。
期待大哥打包个docker环境!!!
感谢!!
数据展示表的很多地方是None,网络资产表却没问题?
建议去除排除资产入库,一是浪费了空间,另一个是导致数据库速度变慢
可否自己批量添加子域名,用来补充扫描不全的状况。
添加后,系统递归爬取友链、爆破子域名,也是提高效率、数量的方法之一
C:\Users\Administrator\Desktop\LangSrcCurise>python manage.py initial
Traceback (most recent call last):
File "manage.py", line 50, in
from initialize.initialdomains import initialdomains
File "C:\Users\Administrator\Desktop\LangSrcCurise\initialize\initialdomains.py", line 12, in
from core.main import Add_Data_To_Url,close_old_connections
File "C:\Users\Administrator\Desktop\LangSrcCurise\core\main.py", line 5, in
from core.Subdomain_Baidu import Baidu
File "C:\Users\Administrator\Desktop\LangSrcCurise\core\Subdomain_Baidu.py", line 37, in
Set = Setting.objects.all()[0]
File "C:\Program Files\Python36\lib\site-packages\django\db\models\query.py", line 303, in getitem
return qs._result_cache[0]
IndexError: list index out of range
win是直接关闭 cmd吗
建议增加泛解析检测
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.