sethmlarson/hstspreload

Chromium HSTS Preload list as a Python package and updated daily.

hstspreload

Chromium HSTS Preload list as a Python package.

Install via python -m pip install hstspreload

See https://hstspreload.org for more information regarding the list itself.

API

The package provides a single function: in_hsts_preload() which takes an IDNA-encoded host and returns either True or False regarding whether that host should be only accessed via HTTPS.

Changelog

This package is built entirely by an automated script running once a month. If you need a release sooner of the package please reach out and I'll trigger a release manually.

This script gathers the HSTS Preload list by monitoring this file in the Chromium repository. Changes to the HSTS Preload list can be seen in the history of that file.

License

BSD-3

hstspreload's Issues

Automate the generation of _GTLD_INCLUDE_SUBDOMAINS value

For new gTLDs that are both in HSTS and require all subdomains we should add them to the _GTLD_INCLUDE_SUBDOMAINS set so they will automatically benefit from the no-I/O path.

tag releases

Would it be possible to tag releases on GitHub that correspond to PyPI releases?

I'm trying to package this for Fedora. I'd like to run the tests during the RPM build, but they aren't included in the PyPI sdist (which is fine), so I need to use a GitHub tarball, but that is more difficult without tags. I don't need all the old releases tagged, but getting the current release and future releases tagged would be awesome.

The cron job is failing for three months

And last release is at 2020.12.22.

Cannot find hstspreload.bin when bundled with PyInstaller

See: https://mystb.in/cipiparicu.py

Traceback (most recent call last):
  File "main.py", line 113, in <module>
  File "click/core.py", line 764, in __call__
  File "click/core.py", line 717, in main
  File "click/core.py", line 1137, in invoke
  File "click/core.py", line 956, in invoke
  File "click/core.py", line 555, in invoke
  File "main.py", line 47, in cmd_download
  File "main.py", line 108, in extract_direct_download_links
  File "main.py", line 97, in do_download
  File "anido/stream_downloader.py", line 50, in download
  File "anido/stream_downloader.py", line 39, in stream
  File "httpx/client.py", line 820, in get
  File "httpx/client.py", line 725, in request
  File "httpx/client.py", line 324, in build_request
  File "httpx/client.py", line 164, in merge_url
  File "hstspreload/__init__.py", line 88, in in_hsts_preload
FileNotFoundError: [Errno 2] No such file or directory: '/var/folders/vr/qsr1bv8j2cs6g7zkkx3x9ggh0000gn/T/_MEI0GSWAu/hstspreload/hstspreload.bin'

Switch to GitHub Actions and test Python 3.6, 3.8

Maybe we can have a shorter test suite for 3.6 and 3.8 but now that we have a set of behavior that is specifically for Python 3.6 we should probably ensure we don't break compatibility.

Create a mode that works well with async

• Create a public name for the binary file path.
• Move the jump tables into the source file to reduce number of seek() calls by half.
• Allow feeding data into a function that returns a tuple of (found, is_leaf, include_subdomain)
• Keep the caching for the sans-I/O approach
• Switch the sync approach to use the sans-I/O approach behind the scenes.

Question About Getting Wheels For Library :)

Hey there!

Hope all has been well!
I really dig this library that's been crafted!

I was wondering if it would ever be possible to get the binary blobs / wheels for the library:

pip3 download --only-binary=:all: hstspreload 

or via:

pip download --only-binary=:all: hstspreload 

To avoid this:

ERROR: Could not find a version that satisfies the requirement hstspreload (from versions: none)
ERROR: No matching distribution found for hstspreload

Thanks for any input / feedback!