sensepost/snoopy

Snoopy: A distributed tracking and data interception framework

snoopy's Issues

Errno 13

Hi,

I installed snoopy on a web-based vm on koding.com, which is both 64-bit and not the recommended version of ubuntu (13), so I knew that this would lead to problems. However, since the install, I am not able to do much with the menus because it keeps aborting my commands with errno 13 permission denied, including just starting the server on managing drone configuration packs.

Thanks!

Running on ESP32?

I'm experimenting with an ESP32 with OLED and BT, and was wondering if there would be a way to make this work on the ESP device? Could it be made lightweight enough?

Snoopy link in readme.md

The first link in the readme file does not lead to any article

Inet

If you change this line:
$(ifconfig | grep "inet addr"| sed 's/.*addr:\(\S*\)\s*.*/\1/'| grep -v "127.0.0.1")
to:
$(ifconfig | grep "inet "| sed 's/.*addr:\(\S*\)\s*.*/\1/'| grep -v "127.0.0.1")

it will be compatible with ubuntu 16.10

easy-rsa is no longer part of openvpn

The installer is depending on easy-rsa which used to be a sub-part of the openvpn project. However, easy-rsa has been moved out of the openvpn project and now will require a seperate installation. Due to this currently the installer.sh script is failing.

Vpn internet connection

I use a virtual machine running a fresh install of ubuntu as my server and a raspberry pi with an alfa awus036h as my drone. Everything works(after some changes and downloading some stuff) until the drone tries to access the internet over vpn.

until ping -c 1 8.8.8.8>/dev/null; do sleep 3; done

"Database error:" logged when trying to access web UI

Hi Glenn,
I'm working on getting your cool project setup using Raspberry Pi devices for the WiFi sensors. For the Snoopy server, I have set up a VM running Ubuntu 12.04 LTS 32bit, as per your notes in the server setup. I'm getting probe data, am seeing wigle activity, and see streetview images being saved under "web_data", so it looks like things are working. When I access the web ui however, I only get the boxes with the mac addresses for the title, but with no content inside the boxes. In the snoopy.log file, I see errors scroll by on each click of the mouse as I try to refresh the view. Please see a snapshot of errors I am seeing below and let me know if you wish me to send the full log for close inspection.

Any ideas?

Thanks!

Jon

2013-04-29 17:03:53 ERROR init.py: Database error:
File "/home/woodstock/snoopy/server/bin/snoopy/src/snoopy/plugins/wigle.py", line 13, in wigle
db.Probe.probe_ssid == db.Wigle.ssid

TypeError('() takes exactly 2 arguments (3 given)',)
2013-04-29 17:03:53 ERROR app.py: Exception on /client/data/get [POST]
Traceback (most recent call last):
File "/usr/lib/python2.7/dist-packages/flask/app.py", line 1504, in wsgi_app
response = self.full_dispatch_request()
File "/usr/lib/python2.7/dist-packages/flask/app.py", line 1264, in full_dispatch_request
rv = self.handle_user_exception(e)
File "/usr/lib/python2.7/dist-packages/flask/app.py", line 1262, in full_dispatch_request
rv = self.dispatch_request()
File "/usr/lib/python2.7/dist-packages/flask/app.py", line 1248, in dispatch_request
return self.view_functionsrule.endpoint
File "/home/woodstock/snoopy/server/bin/snoopy/src/snoopy/web/init.py", line 14, in decorated_function
return f(_args, *_kwargs)
File "/home/woodstock/snoopy/server/bin/snoopy/src/snoopy/web/main.py", line 98, in client_data_get
cldata[options['name']] = dict(title=options['title'], data=fn(mac))
File "/home/woodstock/snoopy/server/bin/snoopy/src/snoopy/plugins/wigle.py", line 13, in wigle
db.Probe.probe_ssid == db.Wigle.ssid
TypeError: () takes exactly 2 arguments (3 given)
2013-04-29 17:03:53 INFO _internal.py: 192.168.1.107 - - [29/Apr/2013 17:03:53] "POST /client/data/get HTTP/1.1" 500 -
2013-04-29 17:03:53 INFO _internal.py: 192.168.1.107 - - [29/Apr/2013 17:03:53] "GET /static/css/images/ui-icons_cccccc_256x240.png HTTP/1.1" 200 -

Server menu runs but status remains stopped

Hi, I am very interesting in working and collaborating with the project but I can't make it run properly on Ubuntu 14:04. The menu runs.. the logs seem to show all correct so I cannot debug the issue on why the status stays stopped. I try to restart, it gets running for some seconds and down again.

---

2016-09-01 17:34:44 INFO snoopy_server.py: Main Snoopy Process starting. Divert all power to the engines!
2016-09-01 17:34:44 INFO prox_guid.py: Starting proximity calculator...
2016-09-01 17:34:44 INFO facebook.py: Starting Facebook stalker
2016-09-01 17:34:44 INFO ssid_to_loc.py: Starting Wigle GeoLocator
2016-09-01 17:34:44 INFO pytail.py: Staring database population engine
2016-09-01 17:34:44 INFO init.py: create_all() complete
2016-09-01 17:34:44 INFO _internal.py: * Running on http://0.0.0.0:5000/

Where I can look for more logs ? Where are the apache config files since I cannot make the drone download page work either.

thanks !!

rpi zero w

can anyone help me install snoopy on raspberry pi zero w?
i have raspbian lite installed on it

wigle_api_lite.py might be broken?

From snoopy.log:

2013-01-09 13:56:31 INFO pytail.py: New probe data!
2013-01-09 13:56:34 INFO ssid_to_loc.py: Looking up address for 8 SSIDs
2013-01-09 13:56:34 INFO wigle_api_lite.py: Wigling xxxxxxx
2013-01-09 13:56:34 INFO wigle_api_lite.py: Using Wigle account xxxxxxxxx
2013-01-09 13:56:34 INFO connectionpool.py: Starting new HTTPS connection (1): wigle.net
2013-01-09 13:56:35 INFO ssid_to_loc.py: An error occured, will retry in 60 seconds (Unable to login to wigle)
2013-01-09 13:56:39 INFO prox_guid.py: 39 devices probing. Grouping into proximity sessions...

I'm clearly no python guru, but if I pull out the code from wiggle_api_lite and try and just isolate it, my understanding is that the below should show the contents of the cookie but fails to - which suggests (to my amateur mind :-) that wigle_api_lite.py is going to always fail as its not going to be able to read 'auth'

rich@h211:~# python

import requests 
 
url={'login': "https://wigle.net/gps/gps/main/login", 'query':"http://wigle.net/gps/gps/main/confirmquery/"} 
payload={'credential_0':'loginname', 'credential_1':'password'} 
r = requests.post(url['login'],data=payload,timeout=10) 
r.cookies['auth']
Traceback (most recent call last):
  File "", line 1, in
  File "/usr/local/lib/python2.7/dist-packages/requests/cookies.py", line 243, in getitem
    return self._find_no_duplicates(name)
  File "/usr/local/lib/python2.7/dist-packages/requests/cookies.py", line 284, in _find_no_duplicates
    raise KeyError('name=%r, domain=%r, path=%r' % (name, domain, path))
KeyError: "name='auth', domain=None, path=None"
 

Curl seems to work:

rich@h211:/tmp# curl --data "credential_0=username&credential_1=password" https://wigle.net/gps/gps/mail/login --dump-header headers

rich@h211:/tmp# curl -L -b headers --data "addresscode=&statecode=&zipcode=&variance=&latrange1=&latrange2=&longrange1=&longrange2=&lastupdt=&netid=&ssid=Hotspot&Query=Query" https://wigle.net/gps/gps/main/confirmquery

stream_socket_client(): php_network_getaddresses: getaddrinfo failed

Hi
I am getting error like stream_socket_client(): php_network_getaddresses: getaddrinfo failed: No such host is known. at Snoopy.class.php on line 875.
any help or suggestion.

Cannot connect to TDS

my main problem is getting the transforms to the TDS server.
everything else works, but when trying to upload to the TDS server, i receive an error 200 from the TDS cause the TDS can not connect with my ubuntu server. I guess cause it is localhost?
how can i get this to work?

pip issue - PIL installation no longer working

When you try to run install.sh it will try to execute pip and install PIL. However some things have changed and due to this the installation will fail on line 116.

Line 116 of install.sh (AS-IS)
pip install lxml beautifulsoup requests PIL mitmproxy ipaddr publicsuffix twisted cryptacular Flask_SQLAlchemy

To resolve this issue lijne 116 needs to be changed to the below:
pip install lxml beautifulsoup requests mitmproxy ipaddr publicsuffix twisted cryptacular Flask_SQLAlchemy

And a second line needs to be added to be able to install PIL seperatly. New line shown below:
pip install PIL --allow-external PIL --allow-unverified PIL

This will give the following codeblock:
116 pip install lxml beautifulsoup requests mitmproxy ipaddr publicsuffix twisted cryptacular Flask_SQLAlchemy
117 pip install PIL --allow-external PIL --allow-unverified PIL
118 if [ "$?" -ne 0 ]; then echo "[!] Failed :("; exit 1; fi
119

Regards,
Johan

Cannot get install.sh to install in ubuntu server

my main problem is getting the transforms to the TDS server.
everything else works, but when trying to upload to the TDS server, i receive an error 200 from the TDS cause the TDS can not connect with my ubuntu server. I guess cause it is localhost?
how can i get this to work?