oldpanda/bloomfilter-py

Yet another Bloomfilter implementation in Python, compatible with Java's Guava library

bloomfilter-py's Issues

How to find the intersection？

     If I get the bloofilter object of two arrays, how to find the intersection of the two arrays？very thankful！！

Add type hints and `mypy` lint checker

Move from setup.py to pyproject.toml

https://peps.python.org/pep-0518/

Byte decoding fails while converting to string.

Use case:

• To convert the bloom filter object into a string in order to store and retrieve as and when required.

Problem:

• While converting the bytes object after using the dumps() method on the bloom filter object into a string via the decode() method, it fails (in some cases when typically the integers added to the filter are larger) as below:

  File ~/.pyenv/versions/3.10.6/lib/python3.10/encodings/utf_8.py:16, in decode(input, errors)
     15 def decode(input, errors='strict'):
  ---> 16     return codecs.utf_8_decode(input, errors, True)
  
  UnicodeDecodeError: 'utf-8' codec can't decode byte 0x80 in position 6: invalid start byte
  

Code to reproduce:

import random
from bloomfilter import BloomFilter
bf = BloomFilter(expected_insertions=10, err_rate=0.1)
bf.put(random.randint(100000000, 10000000000))
bf.put(random.randint(100000000, 10000000000))
bf.dumps().decode()

My observations:

The encoding being used here for serializing the bloom filter to bytes is neither of [utf-8, ascii, utf-16, utf-32] as the byte codecs seen are not supported in either of these.

Probable solutions:

1. Use the utf-8 encoding while serializing the bloom filter object.
2. Allow users to specify the encoding to be used.

Add more Python versions to GitHub actions

To support latest versions of Python