emileaben/eyeballtrace

Do RIPE Atlas traceroutes from networks with significant user populations in a country

eyeballtrace's Issues

data URL unavailable

I can't get eyeballtrace working producing exception below.

$ python -V
Python 2.7.9

$ ./eyeballtrace -c de www.google.com
data URL unavailable, exiting (URL:http://data.labs.apnic.net/ipv6-measurement/Economies/DE/DE.asns.json?m=1)
Traceback (most recent call last):
File "./eyeballtrace", line 166, in
doit( args )
File "./eyeballtrace", line 80, in doit
probe_selection,econdata,prb2as = select_probes_based_on_market( args )
File "./eyeballtrace", line 60, in select_probes_based_on_market
if len( econdata ) == 0:
UnboundLocalError: local variable 'econdata' referenced before assignment

APNIC_ECON service is down, any "mirrors" available?

I found that service is down (or not available for me).
python eyeballtrace -c DE 58.20.xxx.xxx
data URL unavailable, exiting (URL:http://data.labs.apnic.net/ipv6-measurement/Economies/CN/CN.asns.json?m=1)
Traceback (most recent call last):
File "eyeballtrace", line 165, in
doit( args )
File "eyeballtrace", line 80, in doit
probe_selection,econdata,prb2as = select_probes_based_on_market( args )
File "eyeballtrace", line 60, in select_probes_based_on_market
if len( econdata ) == 0:
UnboundLocalError: local variable 'econdata' referenced before assignment

In eyeballtrace code I found it's pointing to
APNIC_ECON_URL="http://data.labs.apnic.net/ipv6-measurement/Economies/%s/%s.asns.json?m=1"

1. Any mirrors available for this service?
2. Maybe it's good idea to handle that exception and return much user friendly error message.

Add support for geographic locations

ie. eyeballtrace -l "New York,NY,US" dest

• country would be learned automatically
• selects probes from (say) within 50 km radius from said city center for significant eyeball networks in that country

Module issue pyOpenSSL<0.14, but you'll have pyopenssl 18.0.0 which is incompatible.

I have problem with python module requirements on OS X, please advice.

pyOpenSSL<0.14, but you'll have pyopenssl 18.0.0 which is incompatible.

$ cd /usr/local/src/
$ git clone https://github.com/emileaben/eyeballtrace
$ cd eyeballtrace/

$ pip install -r requirements.txt
Requirement already satisfied: socketIO-client==0.6.1 in /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages (from -r requirements.txt (line 1)) (0.6.1)
Requirement already satisfied: dnspython==1.11.1 in /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages (from -r requirements.txt (line 2)) (1.11.1)
Requirement already satisfied: Jinja2==2.7.3 in /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages (from -r requirements.txt (line 3)) (2.7.3)
Requirement already satisfied: ripe.atlas.sagan==0.1.15 in /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages (from -r requirements.txt (line 4)) (0.1.15)
Requirement already satisfied: py-radix==0.7.0 in /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages (from -r requirements.txt (line 5)) (0.7.0)
Requirement already satisfied: arrow==0.4.2 in /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages (from -r requirements.txt (line 6)) (0.4.2)
Requirement already satisfied: requests==2.6.0 in /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages (from -r requirements.txt (line 7)) (2.6.0)
Requirement already satisfied: six in /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages (from socketIO-client==0.6.1->-r requirements.txt (line 1)) (1.11.0)
Requirement already satisfied: websocket-client in /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages (from socketIO-client==0.6.1->-r requirements.txt (line 1)) (0.51.0)
Requirement already satisfied: markupsafe in /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages (from Jinja2==2.7.3->-r requirements.txt (line 3)) (1.0)
Requirement already satisfied: python-dateutil>=2.2 in /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages (from ripe.atlas.sagan==0.1.15->-r requirements.txt (line 4)) (2.7.3)
Requirement already satisfied: pytz>=2014.2 in /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages (from ripe.atlas.sagan==0.1.15->-r requirements.txt (line 4)) (2018.5)
Requirement already satisfied: IPy in /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages (from ripe.atlas.sagan==0.1.15->-r requirements.txt (line 4)) (0.83)
Collecting pyOpenSSL>=0.12 (from ripe.atlas.sagan==0.1.15->-r requirements.txt (line 4))
  Using cached https://files.pythonhosted.org/packages/96/af/9d29e6bd40823061aea2e0574ccb2fcf72bfd6130ce53d32773ec375458c/pyOpenSSL-18.0.0-py2.py3-none-any.whl
Requirement already satisfied: dnspython3>=1.11.1 in /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages (from ripe.atlas.sagan==0.1.15->-r requirements.txt (line 4)) (1.15.0)
Requirement already satisfied: cryptography>=2.2.1 in /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages (from pyOpenSSL>=0.12->ripe.atlas.sagan==0.1.15->-r requirements.txt (line 4)) (2.3.1)
Requirement already satisfied: cffi!=1.11.3,>=1.7 in /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages (from cryptography>=2.2.1->pyOpenSSL>=0.12->ripe.atlas.sagan==0.1.15->-r requirements.txt (line 4)) (1.11.5)
Requirement already satisfied: idna>=2.1 in /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages (from cryptography>=2.2.1->pyOpenSSL>=0.12->ripe.atlas.sagan==0.1.15->-r requirements.txt (line 4)) (2.7)
Requirement already satisfied: asn1crypto>=0.21.0 in /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages (from cryptography>=2.2.1->pyOpenSSL>=0.12->ripe.atlas.sagan==0.1.15->-r requirements.txt (line 4)) (0.24.0)
Requirement already satisfied: pycparser in /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages (from cffi!=1.11.3,>=1.7->cryptography>=2.2.1->pyOpenSSL>=0.12->ripe.atlas.sagan==0.1.15->-r requirements.txt (line 4)) (2.18)
ripe-atlas-sagan 0.1.15 has requirement pyOpenSSL<0.14, but you'll have pyopenssl 18.0.0 which is incompatible.
Installing collected packages: pyOpenSSL
Successfully installed pyOpenSSL-18.0.0

$ pip list
Package          Version  
---------------- ---------
arrow            0.4.2    
asn1crypto       0.24.0   
certifi          2018.4.16
cffi             1.11.5   
chardet          3.0.4    
cryptography     2.3.1    
distorm3         3.3.4    
dnspython        1.11.1   
dnspython3       1.15.0   
idna             2.7      
IPy              0.83     
Jinja2           2.7.3    
MarkupSafe       1.0      
pip              18.0     
py-radix         0.7.0    
pycparser        2.18     
pycrypto         2.6.1    
pyOpenSSL        18.0.0   
python-dateutil  2.7.3    
pytz             2018.5   
requests         2.6.0    
ripe.atlas.sagan 0.1.15   
setuptools       39.0.1   
six              1.11.0   
socketIO-client  0.6.1    
urllib3          1.23     
websocket-client 0.51.0   

eyeball data out of date and does not reflect mobile

looking through several countries, I see a large discrepancy between mobile users and eyeball estimations. mobile networks seem underrepresented, leading to suspect some issues with estimation methodology. is there any work under way to generate better estimates or otherwise reprocess existing data to have better estimates for eyeball network sizes?

Please choose a license for this repo

Just a friendly reminder that it's quite helpful to choose a good license for your repo.

The current situation (no explicit license in the repo) means that nobody should clone or use this repo to make a derivative work.

That's probably not what you want, but github makes this pretty clear on their licensing page... quoting:

You're under no obligation to choose a license. However, without a license, the default copyright laws apply, meaning that you retain all rights to your source code and no one may reproduce, distribute, or create derivative works from your work. If you're creating an open source project, we strongly encourage you to include an open source license. The Open Source Guide provides additional guidance on choosing the correct license for your project.

Based on your other (licensed) repos, I suspect you'd go for GPLv3...