Pyhttpx

基于socket开发的一个网络库,供研究https/tls参考如果你用过requests,它将会变得非常容易

PyPI:

$ python -m pip install --upgrade pip
$ python -m pip install pyhttpx

安装依赖

requirement.txt

cryptography==36.0.1
rsa==4.8
pyOpenSSL==21.0.0
brotli==1.0.9

GET

>>> import pyhttpx
>>> sess = pyhttpx.HttpSession()
>>> r = sess.get('https://httpbin.org/get',headers={'User-Agent':'3301'},cookies={'k':'3301')
>>> r = sess.get('https://httpbin.org/get',headers={'User-Agent':'3301'},cookies='k=3301')
>>> r.status_code
200
>>> r.encoding
'utf-8'
>>> r.text
'{\n  "args": {}, ...
>>> r.json
{'args': {},...

如果你想知道原生http报文是否达到预期,你可以这样

>>> r.request.raw
b'GET /get HTTP/1.1\r\nHost: httpbin.org ...

POST

>>> r = sess.post('https://httpbin.org/get',data={})
>>> r = sess.post('https://httpbin.org/get',json={})

HTTP PROXY

>>> proxies = {'https': '127.0.0.1:7890'}
>>> proxy_auth = (username, password)
>>> r = sess.post('https://httpbin.org/get',proxies=proxies,proxy_auth=proxy_auth)

ALLOW_REDIRECTS

>>> r = sess.post('https://httpbin.org/get',allow_redirects=True)

查看tls指纹

https://tls.peet.ws/api/all
下载wireshark,查看完整握手流程，如果服务器返回已实现的密码套件,可随意魔改client hello包
ja3和User-Agent建议使用同一个浏览器的信息

如何禁用firefox的tls1.3, 强制tls1.2

地址栏输入: about:config,
搜索tls,将security.tls.version.max的值改为3即可

如何禁用firefox的http2,强制http/1.1

地址栏输入: about:config,
搜索http2,将network.http.spdy.enabled.http2的值改为false即可

HttpSession 可选参数说明

ja3: 指纹构成 browser_type: chrome or firefox

>>>sess = pyhttpx.HttpSession(browser_type='chrome')
>>>r = sess.get('https://tls.peet.ws/api/all')
>>>r.text
... "ja3": "771,4865-4866...

支持ssl上下文

如果数据是空字符,表示收到fin,服务器断开连接

>>>from pyhttpx.layers.tls.pyssl import SSLContext,PROTOCOL_TLSv1_2
>>>import socket
>>>addres = ('httpbin.org', 443)
>>>context = SSLContext(PROTOCOL_TLSv1_2)
>>>sock = socket.socket(socket.AF_INET, socket.SOCK_STREAM, 0)
>>>ssock = context.wrap_socket(sock, server_hostname=addres[0])
>>>ssock.connect(addres)
>>>m = 'GET / HTTP/1.1\r\nHost: %s\r\n\r\n' % addres[0]
>>>ssock.sendall(m.encode())
>>>r = ssock.recv()
b'HTTP/1.0 200 OK\r\n'...

websocket,支持修改ja3

参考文档tests/test_websockt.py

版本支持

tls1.2/tls1.3
http/1.1

tls密码套件支持

TLS13_AES_128_GCM_SHA256(0X1301)
TLS13_AES_256_GCM_SHA384(0X1302)
TLS13_CHACHA20_POLY1305_SHA256(0X1303)
ECDHE_WITH_AES_128_GCM
ECDHE_WITH_AES_256_GCM
ECDHE_WITH_CHACHA20_POLY1305_SHA256
RSA_WITH_AES_128_GCM
RSA_WITH_AES_256_GCM
RSA_WITH_AES_128_CBC
RSA_WITH_AES_256_CBC
ECDHE_WITH_AES_128_CBC
ECDHE_WITH_AES_256_CBC

附录tls相关资料

tls1.2
tls1.3

end

有什么bug, 或者好设计模式, 欢迎大家issues, wechat: ZanCoder

如果对你有帮助,可以请我喝杯咖啡哟

dux-python / pyhttpx Goto Github PK

pyhttpx's Introduction