Comments (3)
IIRC, less setup, less hassle building for the target arch, less maintenance effort in general, since sqlite3 binary file no longer needs to be bundled.
At first I couldn't figure out how to process and query large CSVs fast, so I cheated with sqlite3.
It's a bit of an overkill for the project overall
from ip-index.
For example when parsing the CSV I take the first octet in each range and use it to group all records by.
This gives 255 buckets of ranges, scoping the amount to iterate over. This could be improved further, but I stopped as soon as I saw couple-millisecond query performance on my machine.
from ip-index.
Thank you. If you don't mind explaining (briefly), what was the solution to process CSVs fast?
from ip-index.
Related Issues (20)
- Potential bug - Missing IP ranges in datacenters HOT 2
- The repository is damn huge HOT 1
- ASN Datacenter HOT 2
- Expose finer grained black list matches HOT 1
- nvm
- License file is missing HOT 2
- No longer frequently updates HOT 1
- AS398083 missing in asn-ip HOT 1
- 2 likely DCH ASNs not in asns_dcs.csv
- Apple Private Relay third party ASNs are in asns_dcs.csv HOT 1
- Feature Request: Ability to query IPV6 addresses HOT 3
- Fetching new versions daily HOT 1
- False positive HOT 4
- AS29447 HOT 4
- Start - end | What is it? HOT 1
- Most requests are returning []
- proxy 45.61.188.135 returns [] HOT 2
- about VPN info HOT 1
- IP 166.198.252.12 returns []
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ip-index.