Giter Site home page Giter Site logo

sjhgvr / oisd Goto Github PK

View Code? Open in Web Editor NEW
67.0 3.0 4.0 2.12 GB

oisd blocklist

Home Page: https://oisd.nl

License: GNU General Public License v3.0

adblocking adblocking-dns adblocking-list adblocklist adblockplus adguardhome blocklist dns pihole-blocklists malware

oisd's Introduction

oisd's People

Contributors

sjhgvr avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar

oisd's Issues

malformed/weird detection

Hi again. I saw these domains were excluded:

Domains that are not included;

117.138.149.34.bc.googleusercontent.com
139.104.205.92.host.secureserver.net
152-42-165-12.cprapid.com
169.253.136.34.bc.googleusercontent.com
18-119-125-196.cprapid.com
209-97-168-213.cprapid.com
21.125.168.184.host.secureserver.net
29.238.205.92.host.secureserver.net
3-14-68-128.ipv4.staticdns2.io
423-42834-92.q8wdkvp4.top
98.172-245-112-195.cprapid.com

For the following reason:

Why is 117.138.149.34.bc.googleusercontent.com not included in the oisd blocklist?

117.138.149.34.bc.googleusercontent.com was found malformed/weird and therefor not included.

These domains are from my PhishStats feed and I manually checked a few to find they indeed resolve to sites (a few of them at least).

Seeing how they all contain IP addresses as subdomains, I suspect it has something to do with your IP address detection? Just thought I'd bring it up in case it affects other blocklists in a larger way than mine.

FP:localhost.sec.qq.com

If this domain is blocked the web page will not be able to use local QQ to login

Work:image
No-work:image

Also need to unblock this domain:localhost.ptlogin2.qq.com
AGH Block logs:image

I try to report on website but fail
image

"Conflict" (HTTP 409) when downloading list(s)

Some lists serve only a HTTP error 409.

[i] Target: https://dbl.oisd.nl/
[✓] Status: Retrieval successful
[i] Imported 795358 domains
[i] List has been updated

[i] Target: https://dbl.oisd.nl/nsfw/
[✗] Status: https://dbl.oisd.nl/nsfw/ (409)
[✗] List download failed: using previously cached list

Because Pi-hole is only storing the latest log from "updateGravity" (updating lists) I can only confirm that on three different systems there has been problems with the NSFW list.

I found this by accident, because I was observing very high CPU load and CPU pressure on my smallest cloud server for my private VPN running a Pi-hole since Mar, 16th starting at 1:55am - is there something running on your side that prevents successfull downloading some(?) lists from dbl.oisd.nl? But also some minutes ago while I was writing this issue I observed an 409 for NSFW list with my Pi-hole…

importet FP's in NSFW list

Hey Stephan

just a friendly note about your NSFW lists.

You happens to import | distribute more than ~7.500.000 unnecessary records most of which is related to blogspot.!com as all blogspot are redirected to .com fro any other blogspot.TLD then there are a hole lot of tumblr sub domain, which are taken down or redirects to subpath.

Next to all of these, I do find a lot of dead domains related to your imports.

You can see those already marked as wontfix here: https://0xacab.org/my-privacy-dns/matrix/-/issues/?sort=created_date&state=opened&in=DESCRIPTION&search=oisd.nl&or%5Blabel_name%5D%5B%5D=Wontfix&first_page_size=100#

For those I haven't tested yet: https://0xacab.org/my-privacy-dns/matrix/-/issues/?sort=created_date&state=opened&in=DESCRIPTION&search=oisd.nl&first_page_size=20

To anticipate those that fails to be added... let's lists all of them our bot couldn't connect to: https://0xacab.org/my-privacy-dns/matrix/-/issues/?sort=created_date&state=opened&in=DESCRIPTION&search=oisd.nl&or%5Blabel_name%5D%5B%5D=On_Hold%3A%3AUnConfirmed&or%5Blabel_name%5D%5B%5D=Need%3A%3AScreenshot&first_page_size=20

while these 50 seems to make it to My Privacy DNS own lists: https://0xacab.org/my-privacy-dns/matrix/-/issues/?sort=created_date&state=opened&in=DESCRIPTION&search=oisd.nl&not%5Blabel_name%5D%5B%5D=Need%3A%3AScreenshot&not%5Blabel_name%5D%5B%5D=On_Hold%3A%3AUnConfirmed&first_page_size=20

Many entries seem to have been removed

We make use of your OISD small block list, and have heard reports from many of our customers that the blocking is not as optimal as it once was. The optimal blocking was perhaps up until around 2-3 weeks ago.

From what I have seen the list of URLs blocked has reduced by about 50%, was there a reason for this?

Do you have any reference to which lists you removed, and why you removed them if so?

Thanks in advance

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.