maringuu/fkie-cve-make-release

fkie-cve-make-release

A script and python package to create a release of nvd-json-data-feeds.

After installing using poetry the script can be used as follows:

Usage: fkie-cve-make-release [OPTIONS] PATH

  Create a release package of the CVE datafeeds released by FKIE-CAD.

Options:
  --date [%Y-%m-%d]    Specifies the state of the database. If not given
                       implies '--fetch'
  --fetch              Fetch the latest changes from https://github.com/fkie-
                       cad/nvd-json-data-feeds
  --xz-preset INTEGER  The xz compression preset level to use.
  --feed-name TEXT     The name of the feed to create. If not given, create
                       all feeds.
  --help               Show this message and exit.

The python package exposes a single class Feed. See it's methods for the package's usage.

fkie-cve-make-release's Issues

The defaults get OOM killed with about 10GB of ram

The 'all' feed with the default compression level (9) requires a significant amount of memory.
Currently, the default is 9 because that is the compression level used in the upstream releases.

A possible solutoin is to make the user explicitly specify the compression preset.