tophanttechnology / arl Goto Github PK
View Code? Open in Web Editor NEWARL(Asset Reconnaissance Lighthouse)资产侦察灯塔系统旨在快速侦察与目标关联的互联网资产,构建基础资产信息库。 协助甲方安全团队或者渗透测试人员有效侦察和检索资产,发现存在的薄弱点和攻击面。
License: Other
ARL(Asset Reconnaissance Lighthouse)资产侦察灯塔系统旨在快速侦察与目标关联的互联网资产,构建基础资产信息库。 协助甲方安全团队或者渗透测试人员有效侦察和检索资产,发现存在的薄弱点和攻击面。
License: Other
如题,今天添加任务的时候提示timeout of 12000ms exceeded,刷新页面,看到任务已添加,但是状态为waiting 等待,且无法删除,现在任务列表里一堆状态为waiting 的,均无法删除
请问如何修改docker默认端口
对于企业级信息收集目前的架构是不能保证信息收集全的
1.收域名枚举的关键字除了开源的关键字库外,需要用到的已经资产的关键字库
2,ICP备案查询也可以用上
3,整体用的信息技术比较单一,没有将这些工具搜集到的东西组合好
4,fofa没有用好,fofa的搜索语法较简单
5,可以看看fofa的api 其实可以获取更多的信息
6 ,指纹识别能力太弱了,用到的指纹库不行,除了库以前,方法也存在较大问题
星光大佬,测试发现不支持 127.0.0.1-255 127.0.0.1-127.0.0.255这种格式的网段。
另外有限制qps嘛?
1,可以让用户自定义武器库,自定义的武器库扫出来结果单独用一个字段存放
2,可以仿照Zoomeye,将这个做成一个空间测绘,聚合用户的收集目标
3,建立企业-资产-漏洞关联
4,根据所有客户输入的信息,将所有客户的指纹进行排名
5,根据指纹,进行漏洞的挖掘
1.建议增加任务的重复扫描 和 周期性的定时扫描计划
2.建议增加扫描结果较上次相比发现新域名时通过邮箱进行通知
您好,之前arl进行采集过的历史纪录无法删除,后续更新是否可以增加删除历史记录模块
alt_dns已经跑了超过一天了
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
4719eabe6ef4 tophant/arl:latest "sh -c 'celery -A ..." 2 minutes ago Restarting (255) 34 seconds ago arl_worker
ef9940cf55c4 tophant/arl:latest "sh -c 'nginx; gun..." 2 minutes ago Restarting (1) 37 seconds ago arl_web
5054aae5854e mongo:3.6-stretch "docker-entrypoint..." 2 minutes ago Up 2 minutes 27017/tcp arl_mongodb
245844a75da1 rabbitmq:3-management-alpine "docker-entrypoint..." 2 minutes ago Up 2 minutes 4369/tcp, 5671-5672/tcp, 15671-15672/tcp, 15691-15692/tcp, 25672/tcp arl_rabbitmq
[root@localhost docker]# ^C
[root@localhost docker]# docker logs 4719eabe6ef4
Parse config.yaml error [Errno 13] Permission denied: '/code/app/config.yaml'
Parse config.yaml error [Errno 13] Permission denied: '/code/app/config.yaml'
Parse config.yaml error [Errno 13] Permission denied: '/code/app/config.yaml'
Parse config.yaml error [Errno 13] Permission denied: '/code/app/config.yaml'
Parse config.yaml error [Errno 13] Permission denied: '/code/app/config.yaml'
Parse config.yaml error [Errno 13] Permission denied: '/code/app/config.yaml'
Parse config.yaml error [Errno 13] Permission denied: '/code/app/config.yaml'
Parse config.yaml error [Errno 13] Permission denied: '/code/app/config.yaml'
Parse config.yaml error [Errno 13] Permission denied: '/code/app/config.yaml'
Parse config.yaml error [Errno 13] Permission denied: '/code/app/config.yaml'
Parse config.yaml error [Errno 13] Permission denied: '/code/app/config.yaml'
[root@localhost docker]# docker logs ef9940cf55c4
Error: Error: 'arl_web.log' isn't writable [PermissionError(13, 'Permission denied')]
Error: Error: 'arl_web.log' isn't writable [PermissionError(13, 'Permission denied')]
Error: Error: 'arl_web.log' isn't writable [PermissionError(13, 'Permission denied')]
Error: Error: 'arl_web.log' isn't writable [PermissionError(13, 'Permission denied')]
Error: Error: 'arl_web.log' isn't writable [PermissionError(13, 'Permission denied')]
Error: Error: 'arl_web.log' isn't writable [PermissionError(13, 'Permission denied')]
Error: Error: 'arl_web.log' isn't writable [PermissionError(13, 'Permission denied')]
Error: Error: 'arl_web.log' isn't writable [PermissionError(13, 'Permission denied')]
Error: Error: 'arl_web.log' isn't writable [PermissionError(13, 'Permission denied')]
Error: Error: 'arl_web.log' isn't writable [PermissionError(13, 'Permission denied')]
Error: Error: 'arl_web.log' isn't writable [PermissionError(13, 'Permission denied')]
Error: Error: 'arl_web.log' isn't writable [PermissionError(13, 'Permission denied')]
一个一个删除我快死了
希望finger字段可以手动编辑,有的时候某个站的指纹没有探测全,就可以手动添加上,方便以后查找
启动后访问5003端口,登录提示timeout of 12000ms exceeded或用户名密码错误,使用默认密码admin/arlpass,未更改过密码。
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
1c1d7ea947d1 tophant/arl:latest "sh -c 'nginx; gunic…" 8 minutes ago Up 8 minutes 0.0.0.0:5003->80/tcp arl_web
c80cac8c122e tophant/arl:latest "sh -c 'celery -A ap…" 8 minutes ago Up 8 minutes arl_worker
5506ae5edf90 rabbitmq:3-management-alpine "docker-entrypoint.s…" 8 minutes ago Up 8 minutes 4369/tcp, 5671-5672/tcp, 15671-15672/tcp, 15691-15692/tcp, 25672/tcp arl_rabbitmq
46844a8a77ca mongo:3.6-stretch "docker-entrypoint.s…" 8 minutes ago Up 8 minutes 27017/tcp arl_mongodb
1)arl_worker
无
2)arl_rabbitmq
Configuring logger redirection
2020-09-16 16:13:39.575 [debug] <0.284.0> Lager installed handler error_logger_lager_h into error_logger
2020-09-16 16:13:39.579 [debug] <0.287.0> Lager installed handler lager_forwarder_backend into error_logger_lager_event
2020-09-16 16:13:39.579 [debug] <0.290.0> Lager installed handler lager_forwarder_backend into rabbit_log_lager_event
2020-09-16 16:13:39.579 [debug] <0.293.0> Lager installed handler lager_forwarder_backend into
......
2020-09-16 16:13:43.264 [info] <0.689.0> Ready to start client connection listeners
2020-09-16 16:13:43.264 [info] <0.44.0> Application rabbitmq_prometheus started on node rabbit@5506ae5edf90
2020-09-16 16:13:43.266 [info] <0.993.0> started TCP listener on [::]:5672
completed with 4 plugins.
2020-09-16 16:13:43.451 [info] <0.689.0> Server startup complete; 4 plugins started.
rabbitmq_prometheus
rabbitmq_management
rabbitmq_web_dispatch
rabbitmq_management_agent
2020-09-16 16:13:43.451 [info] <0.689.0> Resetting node maintenance status
3)arl_web
[2020-09-17 00:13:37 +0800] [10] [INFO] Starting gunicorn 19.9.0
[2020-09-17 00:13:37 +0800] [10] [INFO] Listening at: http://0.0.0.0:5003 (10)
[2020-09-17 00:13:37 +0800] [10] [INFO] Using worker: sync
[2020-09-17 00:13:37 +0800] [19] [INFO] Booting worker with pid: 19
[2020-09-17 00:13:37 +0800] [20] [INFO] Booting worker with pid: 20
[2020-09-17 00:13:37 +0800] [21] [INFO] Booting worker with pid: 21
[2020-09-17 00:14:29 +0800] [10] [CRITICAL] WORKER TIMEOUT (pid:19)
[2020-09-17 00:14:29 +0800] [19] [INFO] Worker exiting (pid: 19)
[2020-09-17 00:14:30 +0800] [31] [INFO] Booting worker with pid: 31
[2020-09-17 00:14:30,834] ERROR in app: Exception on /api/user/login [POST]
Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1612, in full_dispatch_request
rv = self.dispatch_request()
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1598, in dispatch_request
return self.view_functionsrule.endpoint
File "/usr/local/lib/python3.6/site-packages/flask_restplus/api.py", line 325, in wrapper
resp = resource(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask/views.py", line 84, in view
return self.dispatch_request(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask_restplus/resource.py", line 44, in dispatch_request
resp = meth(*args, **kwargs)
File "/code/app/routes/user.py", line 31, in post
return build_data(utils.user_login(**args))
File "/code/app/utils/user.py", line 15, in user_login
if conn_db('user').find_one(query):
File "/usr/local/lib64/python3.6/site-packages/pymongo/collection.py", line 1262, in find_one
for result in cursor.limit(-1):
File "/usr/local/lib64/python3.6/site-packages/pymongo/cursor.py", line 1189, in next
if len(self.__data) or self._refresh():
File "/usr/local/lib64/python3.6/site-packages/pymongo/cursor.py", line 1087, in _refresh
self.__session = self.__collection.database.client._ensure_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1558, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1511, in __start_session
server_session = self._get_server_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1544, in _get_server_session
return self._topology.get_server_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/topology.py", line 427, in get_server_session
None)
File "/usr/local/lib64/python3.6/site-packages/pymongo/topology.py", line 199, in _select_servers_loop
self._error_message(selector))
pymongo.errors.ServerSelectionTimeoutError: mongodb:27017: [Errno 113] No route to host
[2020-09-17 00:14:52,388] ERROR in app: Exception on /api/user/login [POST]
Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1612, in full_dispatch_request
rv = self.dispatch_request()
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1598, in dispatch_request
return self.view_functionsrule.endpoint
File "/usr/local/lib/python3.6/site-packages/flask_restplus/api.py", line 325, in wrapper
resp = resource(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask/views.py", line 84, in view
return self.dispatch_request(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask_restplus/resource.py", line 44, in dispatch_request
resp = meth(*args, **kwargs)
File "/code/app/routes/user.py", line 31, in post
return build_data(utils.user_login(**args))
File "/code/app/utils/user.py", line 15, in user_login
if conn_db('user').find_one(query):
File "/usr/local/lib64/python3.6/site-packages/pymongo/collection.py", line 1262, in find_one
for result in cursor.limit(-1):
File "/usr/local/lib64/python3.6/site-packages/pymongo/cursor.py", line 1189, in next
if len(self.__data) or self._refresh():
File "/usr/local/lib64/python3.6/site-packages/pymongo/cursor.py", line 1087, in _refresh
self.__session = self.__collection.database.client._ensure_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1558, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1511, in __start_session
server_session = self._get_server_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1544, in _get_server_session
return self._topology.get_server_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/topology.py", line 427, in get_server_session
None)
File "/usr/local/lib64/python3.6/site-packages/pymongo/topology.py", line 199, in _select_servers_loop
self._error_message(selector))
pymongo.errors.ServerSelectionTimeoutError: mongodb:27017: [Errno 113] No route to host
[2020-09-17 00:14:52 +0800] [10] [CRITICAL] WORKER TIMEOUT (pid:20)
[2020-09-17 00:14:52 +0800] [20] [INFO] Worker exiting (pid: 20)
[2020-09-17 00:14:53 +0800] [37] [INFO] Booting worker with pid: 37
[2020-09-17 00:15:02,757] ERROR in app: Exception on /api/user/login [POST]
Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1612, in full_dispatch_request
rv = self.dispatch_request()
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1598, in dispatch_request
return self.view_functionsrule.endpoint
File "/usr/local/lib/python3.6/site-packages/flask_restplus/api.py", line 325, in wrapper
resp = resource(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask/views.py", line 84, in view
return self.dispatch_request(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask_restplus/resource.py", line 44, in dispatch_request
resp = meth(*args, **kwargs)
File "/code/app/routes/user.py", line 31, in post
return build_data(utils.user_login(**args))
File "/code/app/utils/user.py", line 15, in user_login
if conn_db('user').find_one(query):
File "/usr/local/lib64/python3.6/site-packages/pymongo/collection.py", line 1262, in find_one
for result in cursor.limit(-1):
File "/usr/local/lib64/python3.6/site-packages/pymongo/cursor.py", line 1189, in next
if len(self.__data) or self._refresh():
File "/usr/local/lib64/python3.6/site-packages/pymongo/cursor.py", line 1087, in _refresh
self.__session = self.__collection.database.client._ensure_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1558, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1511, in __start_session
server_session = self._get_server_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1544, in _get_server_session
return self._topology.get_server_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/topology.py", line 427, in get_server_session
None)
File "/usr/local/lib64/python3.6/site-packages/pymongo/topology.py", line 199, in _select_servers_loop
self._error_message(selector))
pymongo.errors.ServerSelectionTimeoutError: mongodb:27017: [Errno 113] No route to host
[2020-09-17 00:15:04 +0800] [10] [CRITICAL] WORKER TIMEOUT (pid:31)
[2020-09-17 00:15:04 +0800] [31] [INFO] Worker exiting (pid: 31)
[2020-09-17 00:15:05 +0800] [39] [INFO] Booting worker with pid: 39
[2020-09-17 00:15:52,132] ERROR in app: Exception on /api/user/login [POST]
Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1612, in full_dispatch_request
rv = self.dispatch_request()
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1598, in dispatch_request
return self.view_functionsrule.endpoint
File "/usr/local/lib/python3.6/site-packages/flask_restplus/api.py", line 325, in wrapper
resp = resource(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask/views.py", line 84, in view
return self.dispatch_request(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask_restplus/resource.py", line 44, in dispatch_request
resp = meth(*args, **kwargs)
File "/code/app/routes/user.py", line 31, in post
return build_data(utils.user_login(**args))
File "/code/app/utils/user.py", line 15, in user_login
if conn_db('user').find_one(query):
File "/usr/local/lib64/python3.6/site-packages/pymongo/collection.py", line 1262, in find_one
for result in cursor.limit(-1):
File "/usr/local/lib64/python3.6/site-packages/pymongo/cursor.py", line 1189, in next
if len(self.__data) or self._refresh():
File "/usr/local/lib64/python3.6/site-packages/pymongo/cursor.py", line 1087, in _refresh
self.__session = self.__collection.database.client._ensure_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1558, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1511, in __start_session
server_session = self._get_server_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1544, in _get_server_session
return self._topology.get_server_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/topology.py", line 427, in get_server_session
None)
File "/usr/local/lib64/python3.6/site-packages/pymongo/topology.py", line 199, in _select_servers_loop
self._error_message(selector))
pymongo.errors.ServerSelectionTimeoutError: mongodb:27017: [Errno 113] No route to host
[2020-09-17 00:15:53,358] ERROR in app: Exception on /api/user/login [POST]
Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1612, in full_dispatch_request
rv = self.dispatch_request()
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1598, in dispatch_request
return self.view_functionsrule.endpoint
File "/usr/local/lib/python3.6/site-packages/flask_restplus/api.py", line 325, in wrapper
resp = resource(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask/views.py", line 84, in view
return self.dispatch_request(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask_restplus/resource.py", line 44, in dispatch_request
resp = meth(*args, **kwargs)
File "/code/app/routes/user.py", line 31, in post
return build_data(utils.user_login(**args))
File "/code/app/utils/user.py", line 15, in user_login
if conn_db('user').find_one(query):
File "/usr/local/lib64/python3.6/site-packages/pymongo/collection.py", line 1262, in find_one
for result in cursor.limit(-1):
File "/usr/local/lib64/python3.6/site-packages/pymongo/cursor.py", line 1189, in next
if len(self.__data) or self._refresh():
File "/usr/local/lib64/python3.6/site-packages/pymongo/cursor.py", line 1087, in _refresh
self.__session = self.__collection.database.client._ensure_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1558, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1511, in __start_session
server_session = self._get_server_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1544, in _get_server_session
return self._topology.get_server_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/topology.py", line 427, in get_server_session
None)
File "/usr/local/lib64/python3.6/site-packages/pymongo/topology.py", line 199, in _select_servers_loop
self._error_message(selector))
pymongo.errors.ServerSelectionTimeoutError: mongodb:27017: [Errno 113] No route to host
[2020-09-17 00:15:54 +0800] [10] [CRITICAL] WORKER TIMEOUT (pid:37)
[2020-09-17 00:15:54 +0800] [37] [INFO] Worker exiting (pid: 37)
[2020-09-17 00:15:55 +0800] [51] [INFO] Booting worker with pid: 51
[2020-09-17 00:16:22 +0800] [10] [CRITICAL] WORKER TIMEOUT (pid:39)
[2020-09-17 00:16:22 +0800] [39] [INFO] Worker exiting (pid: 39)
[2020-09-17 00:16:23 +0800] [10] [CRITICAL] WORKER TIMEOUT (pid:21)
[2020-09-17 00:16:23 +0800] [21] [INFO] Worker exiting (pid: 21)
[2020-09-17 00:16:23 +0800] [55] [INFO] Booting worker with pid: 55
[2020-09-17 00:16:24 +0800] [59] [INFO] Booting worker with pid: 59
[2020-09-17 00:16:26 +0800] [10] [CRITICAL] WORKER TIMEOUT (pid:51)
[2020-09-17 00:16:26 +0800] [51] [INFO] Worker exiting (pid: 51)
[2020-09-17 00:16:27 +0800] [63] [INFO] Booting worker with pid: 63
[2020-09-17 00:16:54,523] ERROR in app: Exception on /api/user/login [POST]
Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1612, in full_dispatch_request
rv = self.dispatch_request()
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1598, in dispatch_request
return self.view_functionsrule.endpoint
File "/usr/local/lib/python3.6/site-packages/flask_restplus/api.py", line 325, in wrapper
resp = resource(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask/views.py", line 84, in view
return self.dispatch_request(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask_restplus/resource.py", line 44, in dispatch_request
resp = meth(*args, **kwargs)
File "/code/app/routes/user.py", line 31, in post
return build_data(utils.user_login(**args))
File "/code/app/utils/user.py", line 15, in user_login
if conn_db('user').find_one(query):
File "/usr/local/lib64/python3.6/site-packages/pymongo/collection.py", line 1262, in find_one
for result in cursor.limit(-1):
File "/usr/local/lib64/python3.6/site-packages/pymongo/cursor.py", line 1189, in next
if len(self.__data) or self._refresh():
File "/usr/local/lib64/python3.6/site-packages/pymongo/cursor.py", line 1087, in _refresh
self.__session = self.__collection.database.client._ensure_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1558, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1511, in __start_session
server_session = self._get_server_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1544, in _get_server_session
return self._topology.get_server_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/topology.py", line 427, in get_server_session
None)
File "/usr/local/lib64/python3.6/site-packages/pymongo/topology.py", line 199, in _select_servers_loop
self._error_message(selector))
pymongo.errors.ServerSelectionTimeoutError: mongodb:27017: [Errno 113] No route to host
[2020-09-17 00:16:55 +0800] [10] [CRITICAL] WORKER TIMEOUT (pid:59)
[2020-09-17 00:16:55 +0800] [59] [INFO] Worker exiting (pid: 59)
[2020-09-17 00:16:56 +0800] [69] [INFO] Booting worker with pid: 69
[2020-09-17 00:16:58,526] ERROR in app: Exception on /api/user/login [POST]
Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1612, in full_dispatch_request
rv = self.dispatch_request()
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1598, in dispatch_request
return self.view_functionsrule.endpoint
File "/usr/local/lib/python3.6/site-packages/flask_restplus/api.py", line 325, in wrapper
resp = resource(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask/views.py", line 84, in view
return self.dispatch_request(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask_restplus/resource.py", line 44, in dispatch_request
resp = meth(*args, **kwargs)
File "/code/app/routes/user.py", line 31, in post
return build_data(utils.user_login(**args))
File "/code/app/utils/user.py", line 15, in user_login
if conn_db('user').find_one(query):
File "/usr/local/lib64/python3.6/site-packages/pymongo/collection.py", line 1262, in find_one
for result in cursor.limit(-1):
File "/usr/local/lib64/python3.6/site-packages/pymongo/cursor.py", line 1189, in next
if len(self.__data) or self._refresh():
File "/usr/local/lib64/python3.6/site-packages/pymongo/cursor.py", line 1087, in _refresh
self.__session = self.__collection.database.client._ensure_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1558, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1511, in __start_session
server_session = self._get_server_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1544, in _get_server_session
return self._topology.get_server_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/topology.py", line 427, in get_server_session
None)
File "/usr/local/lib64/python3.6/site-packages/pymongo/topology.py", line 199, in _select_servers_loop
self._error_message(selector))
pymongo.errors.ServerSelectionTimeoutError: mongodb:27017: [Errno 113] No route to host
[2020-09-17 00:17:24 +0800] [10] [CRITICAL] WORKER TIMEOUT (pid:55)
[2020-09-17 00:17:24 +0800] [55] [INFO] Worker exiting (pid: 55)
[2020-09-17 00:17:25 +0800] [75] [INFO] Booting worker with pid: 75
[2020-09-17 00:17:27,594] ERROR in app: Exception on /api/user/login [POST]
Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1612, in full_dispatch_request
rv = self.dispatch_request()
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1598, in dispatch_request
return self.view_functionsrule.endpoint
File "/usr/local/lib/python3.6/site-packages/flask_restplus/api.py", line 325, in wrapper
resp = resource(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask/views.py", line 84, in view
return self.dispatch_request(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask_restplus/resource.py", line 44, in dispatch_request
resp = meth(*args, **kwargs)
File "/code/app/routes/user.py", line 31, in post
return build_data(utils.user_login(**args))
File "/code/app/utils/user.py", line 15, in user_login
if conn_db('user').find_one(query):
File "/usr/local/lib64/python3.6/site-packages/pymongo/collection.py", line 1262, in find_one
for result in cursor.limit(-1):
File "/usr/local/lib64/python3.6/site-packages/pymongo/cursor.py", line 1189, in next
if len(self.__data) or self._refresh():
File "/usr/local/lib64/python3.6/site-packages/pymongo/cursor.py", line 1087, in _refresh
self.__session = self.__collection.database.client._ensure_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1558, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1511, in __start_session
server_session = self._get_server_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1544, in _get_server_session
return self._topology.get_server_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/topology.py", line 427, in get_server_session
None)
File "/usr/local/lib64/python3.6/site-packages/pymongo/topology.py", line 199, in _select_servers_loop
self._error_message(selector))
pymongo.errors.ServerSelectionTimeoutError: mongodb:27017: [Errno 113] No route to host
[2020-09-17 00:17:28 +0800] [10] [CRITICAL] WORKER TIMEOUT (pid:63)
[2020-09-17 00:17:28 +0800] [63] [INFO] Worker exiting (pid: 63)
[2020-09-17 00:17:29 +0800] [79] [INFO] Booting worker with pid: 79
[2020-09-17 00:17:56 +0800] [10] [CRITICAL] WORKER TIMEOUT (pid:75)
[2020-09-17 00:17:56 +0800] [75] [INFO] Worker exiting (pid: 75)
[2020-09-17 00:17:57 +0800] [81] [INFO] Booting worker with pid: 81
[2020-09-17 00:18:57,987] ERROR in app: Exception on /api/user/login [POST]
Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1612, in full_dispatch_request
rv = self.dispatch_request()
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1598, in dispatch_request
return self.view_functionsrule.endpoint
File "/usr/local/lib/python3.6/site-packages/flask_restplus/api.py", line 325, in wrapper
resp = resource(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask/views.py", line 84, in view
return self.dispatch_request(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask_restplus/resource.py", line 44, in dispatch_request
resp = meth(*args, **kwargs)
File "/code/app/routes/user.py", line 31, in post
return build_data(utils.user_login(**args))
File "/code/app/utils/user.py", line 15, in user_login
if conn_db('user').find_one(query):
File "/usr/local/lib64/python3.6/site-packages/pymongo/collection.py", line 1262, in find_one
for result in cursor.limit(-1):
File "/usr/local/lib64/python3.6/site-packages/pymongo/cursor.py", line 1189, in next
if len(self.__data) or self._refresh():
File "/usr/local/lib64/python3.6/site-packages/pymongo/cursor.py", line 1087, in _refresh
self.__session = self.__collection.database.client._ensure_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1558, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1511, in __start_session
server_session = self._get_server_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1544, in _get_server_session
return self._topology.get_server_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/topology.py", line 427, in get_server_session
None)
File "/usr/local/lib64/python3.6/site-packages/pymongo/topology.py", line 199, in _select_servers_loop
self._error_message(selector))
pymongo.errors.ServerSelectionTimeoutError: mongodb:27017: [Errno 113] No route to host
[2020-09-17 00:18:58,996] ERROR in app: Exception on /api/user/login [POST]
Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1612, in full_dispatch_request
rv = self.dispatch_request()
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1598, in dispatch_request
return self.view_functionsrule.endpoint
File "/usr/local/lib/python3.6/site-packages/flask_restplus/api.py", line 325, in wrapper
resp = resource(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask/views.py", line 84, in view
return self.dispatch_request(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask_restplus/resource.py", line 44, in dispatch_request
resp = meth(*args, **kwargs)
File "/code/app/routes/user.py", line 31, in post
return build_data(utils.user_login(**args))
File "/code/app/utils/user.py", line 15, in user_login
if conn_db('user').find_one(query):
File "/usr/local/lib64/python3.6/site-packages/pymongo/collection.py", line 1262, in find_one
for result in cursor.limit(-1):
File "/usr/local/lib64/python3.6/site-packages/pymongo/cursor.py", line 1189, in next
if len(self.__data) or self._refresh():
File "/usr/local/lib64/python3.6/site-packages/pymongo/cursor.py", line 1087, in _refresh
self.__session = self.__collection.database.client._ensure_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1558, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1511, in __start_session
server_session = self._get_server_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1544, in _get_server_session
return self._topology.get_server_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/topology.py", line 427, in get_server_session
None)
File "/usr/local/lib64/python3.6/site-packages/pymongo/topology.py", line 199, in _select_servers_loop
self._error_message(selector))
pymongo.errors.ServerSelectionTimeoutError: mongodb:27017: [Errno 113] No route to host
[2020-09-17 00:19:00,533] ERROR in app: Exception on /api/user/login [POST]
Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1612, in full_dispatch_request
rv = self.dispatch_request()
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1598, in dispatch_request
return self.view_functionsrule.endpoint
File "/usr/local/lib/python3.6/site-packages/flask_restplus/api.py", line 325, in wrapper
resp = resource(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask/views.py", line 84, in view
return self.dispatch_request(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask_restplus/resource.py", line 44, in dispatch_request
resp = meth(*args, **kwargs)
File "/code/app/routes/user.py", line 31, in post
return build_data(utils.user_login(**args))
File "/code/app/utils/user.py", line 15, in user_login
if conn_db('user').find_one(query):
File "/usr/local/lib64/python3.6/site-packages/pymongo/collection.py", line 1262, in find_one
for result in cursor.limit(-1):
File "/usr/local/lib64/python3.6/site-packages/pymongo/cursor.py", line 1189, in next
if len(self.__data) or self._refresh():
File "/usr/local/lib64/python3.6/site-packages/pymongo/cursor.py", line 1087, in _refresh
self.__session = self.__collection.database.client._ensure_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1558, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1511, in __start_session
server_session = self._get_server_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1544, in _get_server_session
return self._topology.get_server_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/topology.py", line 427, in get_server_session
None)
File "/usr/local/lib64/python3.6/site-packages/pymongo/topology.py", line 199, in _select_servers_loop
self._error_message(selector))
pymongo.errors.ServerSelectionTimeoutError: mongodb:27017: [Errno 113] No route to host
[2020-09-17 00:19:28,065] ERROR in app: Exception on /api/user/login [POST]
Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1612, in full_dispatch_request
rv = self.dispatch_request()
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1598, in dispatch_request
return self.view_functionsrule.endpoint
File "/usr/local/lib/python3.6/site-packages/flask_restplus/api.py", line 325, in wrapper
resp = resource(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask/views.py", line 84, in view
return self.dispatch_request(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask_restplus/resource.py", line 44, in dispatch_request
resp = meth(*args, **kwargs)
File "/code/app/routes/user.py", line 31, in post
return build_data(utils.user_login(**args))
File "/code/app/utils/user.py", line 15, in user_login
if conn_db('user').find_one(query):
File "/usr/local/lib64/python3.6/site-packages/pymongo/collection.py", line 1262, in find_one
for result in cursor.limit(-1):
File "/usr/local/lib64/python3.6/site-packages/pymongo/cursor.py", line 1189, in next
if len(self.__data) or self._refresh():
File "/usr/local/lib64/python3.6/site-packages/pymongo/cursor.py", line 1087, in _refresh
self.__session = self.__collection.database.client._ensure_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1558, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1511, in __start_session
server_session = self._get_server_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1544, in _get_server_session
return self._topology.get_server_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/topology.py", line 427, in get_server_session
None)
File "/usr/local/lib64/python3.6/site-packages/pymongo/topology.py", line 199, in _select_servers_loop
self._error_message(selector))
pymongo.errors.ServerSelectionTimeoutError: mongodb:27017: [Errno 113] No route to host
4)arl_mongodb
about to fork child process, waiting until server is ready for connections.
forked process: 26
2020-09-16T16:13:34.110+0000 I CONTROL [main] ***** SERVER RESTARTED *****
2020-09-16T16:13:34.118+0000 I CONTROL [initandlisten] MongoDB starting : pid=26 port=27017 dbpath=/data/db 64-bit host=46844a8a77ca
2020-09-16T16:13:34.118+0000 I CONTROL [initandlisten] db version v3.6.11
2020-09-16T16:13:34.118+0000 I CONTROL [initandlisten] git version: b4339db12bf57ffee5b84a95c6919dbd35fe31c9
2020-09-16T16:13:34.118+0000 I CONTROL [initandlisten] OpenSSL version: OpenSSL 1.1.0j 20 Nov 2018
2020-09-16T16:13:34.118+0000 I CONTROL [initandlisten] allocator: tcmalloc
2020-09-16T16:13:34.118+0000 I CONTROL [initandlisten] modules: none
2020-09-16T16:13:34.118+0000 I CONTROL [initandlisten] build environment:
2020-09-16T16:13:34.118+0000 I CONTROL [initandlisten] distmod: debian92
2020-09-16T16:13:34.118+0000 I CONTROL [initandlisten] distarch: x86_64
2020-09-16T16:13:34.118+0000 I CONTROL [initandlisten] target_arch: x86_64
......
Successfully added user: {
"user" : "admin",
"roles" : [
{
"role" : "root",
"db" : "admin"
}
]
}
......
"PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 5.8.6-1-MANJARO" } }
2020-09-16T16:17:56.347+0000 I ACCESS [conn1] Successfully authenticated as principal admin on admin
2020-09-16T16:17:56.350+0000 I ACCESS [conn1] Successfully authenticated as principal admin on admin
2020-09-16T16:18:19.463+0000 I NETWORK [conn1] end connection 127.0.0.1:37096 (0 connections now open)
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
4719eabe6ef4 tophant/arl:latest "sh -c 'celery -A ..." 2 minutes ago Restarting (255) 34 seconds ago arl_worker
ef9940cf55c4 tophant/arl:latest "sh -c 'nginx; gun..." 2 minutes ago Restarting (1) 37 seconds ago arl_web
5054aae5854e mongo:3.6-stretch "docker-entrypoint..." 2 minutes ago Up 2 minutes 27017/tcp arl_mongodb
245844a75da1 rabbitmq:3-management-alpine "docker-entrypoint..." 2 minutes ago Up 2 minutes 4369/tcp, 5671-5672/tcp, 15671-15672/tcp, 15691-15692/tcp, 25672/tcp arl_rabbitmq
[root@localhost docker]# ^C
[root@localhost docker]# docker logs 4719eabe6ef4
Parse config.yaml error [Errno 13] Permission denied: '/code/app/config.yaml'
Parse config.yaml error [Errno 13] Permission denied: '/code/app/config.yaml'
Parse config.yaml error [Errno 13] Permission denied: '/code/app/config.yaml'
Parse config.yaml error [Errno 13] Permission denied: '/code/app/config.yaml'
Parse config.yaml error [Errno 13] Permission denied: '/code/app/config.yaml'
Parse config.yaml error [Errno 13] Permission denied: '/code/app/config.yaml'
Parse config.yaml error [Errno 13] Permission denied: '/code/app/config.yaml'
Parse config.yaml error [Errno 13] Permission denied: '/code/app/config.yaml'
Parse config.yaml error [Errno 13] Permission denied: '/code/app/config.yaml'
Parse config.yaml error [Errno 13] Permission denied: '/code/app/config.yaml'
Parse config.yaml error [Errno 13] Permission denied: '/code/app/config.yaml'
[root@localhost docker]# docker logs ef9940cf55c4
Error: Error: 'arl_web.log' isn't writable [PermissionError(13, 'Permission denied')]
Error: Error: 'arl_web.log' isn't writable [PermissionError(13, 'Permission denied')]
Error: Error: 'arl_web.log' isn't writable [PermissionError(13, 'Permission denied')]
Error: Error: 'arl_web.log' isn't writable [PermissionError(13, 'Permission denied')]
Error: Error: 'arl_web.log' isn't writable [PermissionError(13, 'Permission denied')]
Error: Error: 'arl_web.log' isn't writable [PermissionError(13, 'Permission denied')]
Error: Error: 'arl_web.log' isn't writable [PermissionError(13, 'Permission denied')]
Error: Error: 'arl_web.log' isn't writable [PermissionError(13, 'Permission denied')]
Error: Error: 'arl_web.log' isn't writable [PermissionError(13, 'Permission denied')]
Error: Error: 'arl_web.log' isn't writable [PermissionError(13, 'Permission denied')]
Error: Error: 'arl_web.log' isn't writable [PermissionError(13, 'Permission denied')]
Error: Error: 'arl_web.log' isn't writable [PermissionError(13, 'Permission denied')]
星光哥,求一份完整的本地部署文档
1、希望可以开发一个实时监控子域名的功能,例如这个爆破子域任务刚完成后就立刻重新爆破或者可以设置过多久再爆破
2、希望可以对相同域名的新增域名有个明显标注,例如我今天对baidu.com扫完后,明天在扫,扫出新的子域名后,可以一眼看出来哪个是新发现的子域名。
docker-compose 启动后,arl_worker和arl_web无限重启,查看docker logs后,发现
PermissionError: [Errno 13] Permission denied: '/code/arl_worker.log'
修改docker-compose.yml进入docker后发现arl_web.log没权限
-rw-r--r--. 1 root root 0 Nov 19 08:33 arl_web.log
应该最可信度最高的,第一个不定是可信度最高的
需要把所有已知的操作系统识别的结果缓存下为,进行可信度排序,然后取可信度最高的版本
答:
第一步:docker exec -ti arl_mongodb mongo -u admin -p admin
第二步:db.task.remove({"_id" : ObjectId("xxxxxxxxxxxxxxx")}) 前端:Task_Id
希望能帮到各位大哥
管理权限
正常操作
首次添加
直接失败
当场懵逼
/usr/local/lib/python3.5/dist-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.5 support will be dropped in the next release ofcryptography. Please upgrade your Python.
from cryptography.hazmat.backends import default_backend
Pulling worker (arl_worker:v2)...
ERROR: The image for the service you're trying to recreate has been removed. If you continue, volume data could be lost. Consider backing up your data before continuing.
Continue with the new image? [yN]
可否 增加多种网络空间引擎 可配置 例如 fofa zomeye shodan
下载的最新的docker-compose.yml还是启动不了
[root@webvul docker]# docker ps -a
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
00c4cf056e58 tophant/arl:latest "sh -c 'celery -A ..." 6 days ago Restarting (255) 36 hours ago arl_worker
949969d897ff tophant/arl:latest "sh -c 'nginx; gun..." 6 days ago Restarting (1) 36 hours ago arl_web
be9614e748fe rabbitmq:3-management-alpine "docker-entrypoint..." 6 days ago Up 6 days 4369/tcp, 5671-5672/tcp, 15671-15672/tcp, 15691-15692/tcp, 25672/tcp arl_rabbitmq
225260e65857 mongo:3.6-stretch "docker-entrypoint..." 6 days ago Up 6 days 27017/tcp
[root@webvul docker]# cat docker-compose.yml | more
version: '3'
services:
web:
image: tophant/arl:latest
container_name: arl_web
restart: unless-stopped
depends_on:
- mongodb
ports:
- "5003:80"
volumes:
- ./arl_web.log:/code/arl_web.log
- ./config-docker.yaml:/code/app/config.yaml
- ./image:/code/app/tmp_screenshot
entrypoint: ["sh", "-c", "nginx; gunicorn -b 0.0.0.0:5003 app.main:arl_app -w 3 --access-logfile arl_web.log"]
environment:
- LANG=en_US.UTF-8
- TZ=Asia/Shanghai
worker:
image: tophant/arl:latest
container_name: arl_worker
restart: unless-stopped
depends_on:
- mongodb
- rabbitmq
volumes:
- ./arl_worker.log:/code/arl_worker.log
- ./config-docker.yaml:/code/app/config.yaml
- ./image:/code/app/tmp_screenshot
entrypoint: ["sh", "-c", "celery -A app.celerytask.celery worker -l info -Q arltask -n arltask -c 2 -O fair -f arl_worker.log"]
environment:
- LANG=en_US.UTF-8
- TZ=Asia/Shanghai
mongodb:
image: mongo:3.6-stretch
container_name: arl_mongodb
restart: always
volumes:
- ./mongo-init.js:/docker-entrypoint-initdb.d/mongo-init.js:ro
environment:
- MONGO_INITDB_DATABASE=arl
- MONGO_INITDB_ROOT_USERNAME=admin
- MONGO_INITDB_ROOT_PASSWORD=admin
rabbitmq:
image: rabbitmq:3-management-alpine
container_name: arl_rabbitmq
restart: always
environment:
- RABBITMQ_DEFAULT_PASS=arlpassword
- RABBITMQ_DEFAULT_USER=arl
- RABBITMQ_DEFAULT_VHOST=arlv2host
logging:
driver: "json-file"
options:
max-size: "1M"
max-file: "10"
比如爆破域名时候我不希望文件泄露探测,但搜索完成后,我又想对部分域名进行文件泄露探测,这就需要一个模块对其独立运行
def os_match_by_accuracy(self, os_match_list):
for os_match in os_match_list:
accuracy = os_match.get('accuracy', '0')
if int(accuracy) > 90:
return os_match
return {}
1.应该对识别出来的可能的操作系统根据accuracy进行可信度排名
当nmap出来的结果 都不可信的时候直接去掉
2 对于操作系统识别可以通过nmap的扫出来的应用进行深层次的操作系统识别
3,可以将所有的回包 用pof进行获得操作系统。
使用docker启动,无法使用默认密码admin/arlpass登陆系统,请问正确的密码?
git 地址如下 https://github.com/TophantTechnology/ARL
`Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 597, in urlopen
httplib_response = self._make_request(conn, method, url,
File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 354, in _make_request
conn.request(method, url, **httplib_request_kw)
File "/usr/lib/python3.8/http/client.py", line 1255, in request
self._send_request(method, url, body, headers, encode_chunked)
File "/usr/lib/python3.8/http/client.py", line 1301, in _send_request
self.endheaders(body, encode_chunked=encode_chunked)
File "/usr/lib/python3.8/http/client.py", line 1250, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
File "/usr/lib/python3.8/http/client.py", line 1010, in _send_output
self.send(msg)
File "/usr/lib/python3.8/http/client.py", line 950, in send
self.connect()
File "/home/orochi/.local/lib/python3.8/site-packages/docker/transport/unixconn.py", line 43, in connect
sock.connect(self.unix_socket)
PermissionError: [Errno 13] Permission denied
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
resp = conn.urlopen(
File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 637, in urlopen
retries = retries.increment(method, url, error=e, _pool=self,
File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 368, in increment
raise six.reraise(type(error), error, _stacktrace)
File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 685, in reraise
raise value.with_traceback(tb)
File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 597, in urlopen
httplib_response = self._make_request(conn, method, url,
File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 354, in _make_request
conn.request(method, url, **httplib_request_kw)
File "/usr/lib/python3.8/http/client.py", line 1255, in request
self._send_request(method, url, body, headers, encode_chunked)
File "/usr/lib/python3.8/http/client.py", line 1301, in _send_request
self.endheaders(body, encode_chunked=encode_chunked)
File "/usr/lib/python3.8/http/client.py", line 1250, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
File "/usr/lib/python3.8/http/client.py", line 1010, in _send_output
self.send(msg)
File "/usr/lib/python3.8/http/client.py", line 950, in send
self.connect()
File "/home/orochi/.local/lib/python3.8/site-packages/docker/transport/unixconn.py", line 43, in connect
sock.connect(self.unix_socket)
urllib3.exceptions.ProtocolError: ('Connection aborted.', PermissionError(13, 'Permission denied'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/orochi/.local/lib/python3.8/site-packages/docker/api/client.py", line 205, in _retrieve_server_version
return self.version(api_version=False)["ApiVersion"]
File "/home/orochi/.local/lib/python3.8/site-packages/docker/api/daemon.py", line 181, in version
return self._result(self._get(url), json=True)
File "/home/orochi/.local/lib/python3.8/site-packages/docker/utils/decorators.py", line 46, in inner
return f(self, *args, **kwargs)
File "/home/orochi/.local/lib/python3.8/site-packages/docker/api/client.py", line 228, in _get
return self.get(url, **self._set_request_timeout(kwargs))
File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 537, in get
return self.request('GET', url, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 524, in request
resp = self.send(prep, **send_kwargs)
File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 637, in send
r = adapter.send(request, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 498, in send
raise ConnectionError(err, request=request)
requests.exceptions.ConnectionError: ('Connection aborted.', PermissionError(13, 'Permission denied'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/orochi/.local/bin/docker-compose", line 8, in
sys.exit(main())
File "/home/orochi/.local/lib/python3.8/site-packages/compose/cli/main.py", line 67, in main
command()
File "/home/orochi/.local/lib/python3.8/site-packages/compose/cli/main.py", line 123, in perform_command
project = project_from_options('.', options)
File "/home/orochi/.local/lib/python3.8/site-packages/compose/cli/command.py", line 60, in project_from_options
return get_project(
File "/home/orochi/.local/lib/python3.8/site-packages/compose/cli/command.py", line 131, in get_project
client = get_client(
File "/home/orochi/.local/lib/python3.8/site-packages/compose/cli/docker_client.py", line 41, in get_client
client = docker_client(
File "/home/orochi/.local/lib/python3.8/site-packages/compose/cli/docker_client.py", line 170, in docker_client
client = APIClient(**kwargs)
File "/home/orochi/.local/lib/python3.8/site-packages/docker/api/client.py", line 188, in init
self._version = self._retrieve_server_version()
File "/home/orochi/.local/lib/python3.8/site-packages/docker/api/client.py", line 212, in _retrieve_server_version
raise DockerException(
docker.errors.DockerException: Error while fetching server API version: ('Connection aborted.', PermissionError(13, 'Permission denied'))
`
截图这些挺好的,导出来都没了
在使用此工具的过程中,我发现有的时候会被目标给办掉,无法访问目标,如果可以添加一个自动获取免费代理节点,通过这些节点去资产发现,会更全面。而且你们也可以再增加一个专属代理节点,付费内种,咳咳。
ERROR: pull access denied for arl_worker, repository does not exist or may require 'docker login': denied: requested access to the resource is denied
(1)在将目标设置成IP段时,IP扫描结果结果只有IP、Geo和AS字段,其他开放端口、操作系统、关联域名为空,另外的SSL证书、子域名、站点、服务、文件泄露和URL信息也为空
(2)在将目标设置IP时,所有的结果均为空
对比masscan扫描结果确实存在IP和端口等
报这个错
ERROR: Version in "./docker-compose.yml" is unsupported. You might be seeing this error because you're using the wrong Compose file version. Either specify a version of "2" (or "2.0") and place your service definitions under the services
key, or omit the version
key and place your service definitions at the root of the file to use version 1.
For more on the Compose file format versions, see https://docs.docker.com/compose/compose-file/
是否可以增加资产导入功能?
docker nginx未安装ngx_http_auth_basic_module模块,无法添加http基础认证
configure arguments: --prefix=/usr/share/nginx --sbin-path=/usr/sbin/nginx --modules-path=/usr/lib64/nginx/modules --conf-path=/etc/nginx/nginx.conf --error-log-path=/var/log/nginx/error.log --http-log-path=/var/log/nginx/access.log --http-client-body-temp-path=/var/lib/nginx/tmp/client_body --http-proxy-temp-path=/var/lib/nginx/tmp/proxy --http-fastcgi-temp-path=/var/lib/nginx/tmp/fastcgi --http-uwsgi-temp-path=/var/lib/nginx/tmp/uwsgi --http-scgi-temp-path=/var/lib/nginx/tmp/scgi --pid-path=/run/nginx.pid --lock-path=/run/lock/subsys/nginx --user=nginx --group=nginx --with-file-aio --with-ipv6 --with-http_ssl_module --with-http_v2_module --with-http_realip_module --with-stream_ssl_preread_module --with-http_addition_module --with-http_xslt_module=dynamic --with-http_image_filter_module=dynamic --with-http_sub_module --with-http_dav_module --with-http_flv_module --with-http_mp4_module --with-http_gunzip_module --with-http_gzip_static_module --with-http_random_index_module --with-http_secure_link_module --with-http_degradation_module --with-http_slice_module --with-http_stub_status_module --with-http_perl_module=dynamic --with-http_auth_request_module --with-mail=dynamic --with-mail_ssl_module --with-pcre --with-pcre-jit --with-stream=dynamic --with-stream_ssl_module --with-google_perftools_module --with-debug --with-cc-opt='-O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -specs=/usr/lib/rpm/redhat/redhat-hardened-cc1 -m64 -mtune=generic' --with-ld-opt='-Wl,-z,relro -specs=/usr/lib/rpm/redhat/redhat-hardened-ld -Wl,-E'
[root@35ec9ed4b1b7 code]#
rt
docker-compose up -d
Starting arl_mongodb ... done
Starting arl_rabbitmq ... done
Starting arl_web ... done
Starting arl_worker ... done
docker-compose ps
5.宿主机无占用80端口的进程,selinux已关
6. 系统版本
[root@localhost docker]# uname -a
Linux localhost.localdomain 3.10.0-1062.18.1.el7.x86_64 #1 SMP Tue Mar 17 23:49:17 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
[root@localhost docker]# docker --version
Docker version 1.13.1, build cccb291/1.13.1
[root@localhost docker]# docker-compose --version
docker-compose version 1.25.0, build 0a186604
8.配置
1,系统能不能支持外部导入导出功能,外部收集的域名信息能和ARL域名做合并;
2,域名收集增加一些维度,API接口查询、搜索引擎...
3,开放API接口方便和其他工具对接;
Thx
建议可以使用自己的字典进行爆破子域名或者建议你们使用字典:https://gist.github.com/jhaddix/86a06c5dc309d08580a018c66354a056,与你们的字典进行去重合并。这才算大字典。
星光🐂🍺
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.