Giter Site home page Giter Site logo

i3visio / osrframework Goto Github PK

View Code? Open in Web Editor NEW
874.0 54.0 240.0 4.21 MB

OSRFramework, the Open Sources Research Framework is a AGPLv3+ project by i3visio focused on providing API and tools to perform more accurate online researches.

License: GNU Affero General Public License v3.0

Python 100.00%
osint hacking user-management internet social-networks pypi investigations gnu-agplv3 python3 osrframework

osrframework's Introduction

OSRFramework

OSRFramework: Open Sources Research Framework

Copyright (C) 2014-2021 F. Brezo and Y. Rubio, i3visio

Version in PyPI License

1 - Description

OSRFramework is a GNU AGPLv3+ set of libraries developed by i3visio to perform Open Source Intelligence collection tasks. They include references to a bunch of different applications related to username checking, DNS lookups, information leaks research, deep web search, regular expressions extraction and many others. At the same time, by means of ad-hoc Maltego transforms, OSRFramework provides a way of making these queries graphically as well as several interfaces to interact with like OSRFConsole or a Web interface.

2 - License: GNU AGPLv3+

This is free software, and you are welcome to redistribute it under certain conditions.

This program is free software: you can redistribute it and/or modify
it under the terms of the GNU Affero General Public License as published by
the Free Software Foundation, either version 3 of the License, or
(at your option) any later version.

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU Affero General Public License for more details.

You should have received a copy of the GNU Affero General Public License
along with this program.  If not, see <http://www.gnu.org/licenses/>.

For more details on this issue, check the COPYING file.

3 - Installation

Fast way to do it on any system for a user with administration privileges:

sudo pip3 install osrframework

You can upgrade to the latest release of the framework with:

sudo pip3 install osrframework --upgrade

This will manage all the dependencies for you and install the latest version of the framework.

If you needed further information on how to install OSRFramework on certain systems, note that you may need to add export PATH=$PATH:$HOME/.local/bin to your ~/.bashrc_profile). This has been confirmed in some distributions, including MacOS. In any case, we recommend you yo have a look at the INSTALL.md file where we provide additional details for these cases.

4 - Basic usage

If everything went correctly (we hope so!), it's time for trying usufy., mailfy and so on. But where are they locally? They are installed in your path meaning that you can open a terminal anywhere and typing the name of the program (seems to be an improvement from previous installations...). Examples:

osrf --help
usufy -n i3visio febrezo yrubiosec -p twitter facebook
searchfy -q "i3visio"
mailfy -n i3visio

Type -h or --help to get more information about which are the parameters of each application.

The tools installed in this package include:

  • alias_generator. Generates candidate nicknames based on known info about the target. Input: information about the target. Output: list of possible nicknames.
  • checkfy. Guesses possible emails based on a list of candidate nicknames and a pattern. Input: list of nicknames and an email pattern. Output. list of emails matching the pattern..
  • domainfy. Finds domains that currently resolve using a given word or nickname. Input: liat of words. Output: domains using that word that currently resolve.
  • mailfy. Find more information about emails taken as a reference either a nickname (to generate a list of possible emails) or the email list. Input: list of nicknames or emails. Output: found information about the email.
  • osrf. Shared wrapper for the rest of the applications. All commands can also be used as osrf usufy…, osrf mailfy…, etc.
  • phonefy. Recovers information about mobile phones linked to known spam practices. Inputs: list of phones. Outputs: Phones linked to spam.
  • searchfy. Finds profiles linked to a fullname. Inputs: list of phones. Outputs: Known profiles linked to the query.
  • usufy. Identifies socialmedia profiles using a given nickname. Inputs: list of nicknames. Outputs: Known profiles in socialmedia using those nicknames.

You can find the configuration files in a folder created in your user home to define the default behaviour of the applications:

# Configuration files for Linux and MacOS
~/.config/OSRFramework/
# Configuration files for Windows
C:\Users\<User>\OSRFramework\

OSRFramework will look for the configuration settings for each application stored there. You can add new credentials there and if something goes wrong, you can always restore the files stored in the defaults subfolder.

If you are experiencing problems, you might fight relevant information in the (FAQ Section)[doc/FAQ.md].

5 - HACKING

If you want to extend the functionalities of OSRFramework and you do not know where to start from, check the HACKING.md file.

6 - AUTHORS

More details about the authors in the AUTHORS.md file.

osrframework's People

Contributors

aabilio avatar brha11 avatar febrezo avatar ffr4nz avatar i3visio avatar lopezalvar avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

osrframework's Issues

Addition of Gravatar

La página es:_

http://es.gravatar.com/matt

Se puede acceder a la web directamente a través de llamadas a la API.
http://es.gravatar.com/matt.json

{ "entry" : [{ "id" : "5", "hash" : "767fc9c115a1b989744c755db47feb60", "requestHash" : "matt", "profileUrl" : "http:\/\/gravatar.com\/matt", "preferredUsername" : "matt", "thumbnailUrl" : "http:\/\/1.gravatar.com\/avatar\/767fc9c115a1b989744c755db47feb60", "photos" : [{ "value" : "http:\/\/1.gravatar.com\/avatar\/767fc9c115a1b989744c755db47feb60", "type" : "thumbnail" }, { "value" : "http:\/\/2.gravatar.com\/userimage\/5\/04bbd674f72c703f6335e2e7a00acc9a" }, { "value" : "http:\/\/1.gravatar.com\/userimage\/5\/2873000ea367cd46cae55418e4eac32c" }, { "value" : "http:\/\/0.gravatar.com\/userimage\/5\/3aa58fdf72ca25952c84b3ac4333d3f9" }, { "value" : "http:\/\/2.gravatar.com\/userimage\/5\/996e579d06df6e3397c29ce1cc4c6799" }, { "value" : "http:\/\/2.gravatar.com\/userimage\/5\/ff5263e8c30557b57e64423ee8496e41" } ], "name" : { "givenName" : "Matt", "familyName" : "Mullenweg", "formatted" : "Matt Mullenweg" }, "displayName" : "Matt", "aboutMe" : "In 2002 I started contributing to Open Source software, and life has just gotten better from there. Co-founder of WordPress, founder Automattic.", "currentLocation" : "embarcadero and townsend, sf ca", "ims" : [{ "type" : "aim", "value" : "photomattnet" } ], "accounts" : [{ "domain" : "facebook.com", "display" : "matt.mullenweg", "url" : "http:\/\/facebook.com\/matt.mullenweg", "username" : "matt.mullenweg", "verified" : "true", "shortname" : "facebook" }, { "domain" : "flickr.com", "display" : "photomatt", "url" : "http:\/\/flickr.com\/photos\/photomatt", "username" : "photomatt", "verified" : "true", "shortname" : "flickr" }, { "domain" : "plus.google.com", "display" : "plus.google.com", "url" : "https:\/\/plus.google.com\/116394575739281318169", "userid" : "116394575739281318169", "verified" : "true", "shortname" : "google" }, { "domain" : "linkedin.com", "display" : "mattm", "url" : "http:\/\/www.linkedin.com\/in\/mattm", "username" : "mattm", "verified" : "true", "shortname" : "linkedin" }, { "domain" : "twitter.com", "display" : "@photomatt", "url" : "http:\/\/twitter.com\/photomatt", "username" : "photomatt", "verified" : "true", "shortname" : "twitter" }, { "domain" : "matt.wordpress.com", "display" : "matt.wordpress.com", "url" : "http:\/\/matt.wordpress.com\/", "username" : "matt.wordpress.com", "verified" : "true", "shortname" : "wordpress" }, { "domain" : "youtube.com", "display" : "mullenweg", "url" : "http:\/\/www.youtube.com\/user\/mullenweg", "username" : "mullenweg", "verified" : "true", "shortname" : "youtube" } ], "urls" : [{ "value" : "http:\/\/ma.tt\/", "title" : "Ma.tt" }, { "value" : "http:\/\/matt.wordpress.com\/", "title" : "Mo-blog" } ] } ] }

Capturing the permission denied exception when unable to access the output file

If the output file provided (by default, `./results/profiles.csv') is already opened by another program such as Libreoffice or Excel, OSRFramework will not be able to write new info on it. Currently it throws a dirty exception. Capturing it and trying to write it in another file may do the trick at least to avoid losing the information recovered.

Giving the chance of launching regular expressions separately

There is an issue with demo versions that only show 12 entities per executed transform. Thus, when launchng big transforms some results are usually missing. The issue may be partially solved by letting the user to launch the transforms separetely in a group. For instance: only i3visio.uri extraction, only i3visio.email, etc.

Searchfy problemas con skype

X11 connection rejected because of wrong authentication.
ERROR: something happened when trying to link to Skype.

Me sale eso al momento de usar searchfy.

En todo caso los resultados me salen igual, felicidades por la herramienta, muy util.

Algunos errores en la busqueda con usufy

Salen falsos positivos, creo que cambiaron los mensajes de error de las siguientes plataformas o bien puede ser el lenguaje de cada mensaje de error, en ebay esta en ingles pero si entro personalmente me sale el mensaje de error en español, puede ser eso?
Ebay
Burbuja.info
arto.com
jamiiforums.com

Saludos.

Jamiiforums is not working

The Jamiiforums platform seems not recognize the self.notFoundText["usufy"] tag. A possibility is the inclusion of new security measures to avoid this monitoring, but this is not confirmed.

Original report at issue #32.

Arto platform is reported not to be working

The arto platform seems not recognize the self.notFoundText["usufy"] tag. Tests on certain machines work, so it may be an issue linked to the language of the error.

Original report at issue #32.

Agregar dependencia en la documentación. (Si es que lo consideran apropiado)

Hola chicos, los conoci a través de la charla de la 8.8 en Santiago, Chile.
Estaba instalando todo lo necesario para probar su sistema y al instalar las dependencias o modulos de python me salio esto.

                    * The following required packages can not be built:

                    * freetype, png

Cleaning up...
Removing temporary dir /tmp/pip_build_root...
Command python setup.py egg_info failed with error code 1 in /tmp/pip_build_root/matplotlib
Exception information:
Traceback (most recent call last):
File "/usr/lib/python2.7/dist-packages/pip/basecommand.py", line 122, in main
status = self.run(options, args)
File "/usr/lib/python2.7/dist-packages/pip/commands/install.py", line 278, in run
requirement_set.prepare_files(finder, force_root_egg_info=self.bundle, bundle=self.bundle)
File "/usr/lib/python2.7/dist-packages/pip/req.py", line 1230, in prepare_files
req_to_install.run_egg_info()
File "/usr/lib/python2.7/dist-packages/pip/req.py", line 326, in run_egg_info
command_desc='python setup.py egg_info')
File "/usr/lib/python2.7/dist-packages/pip/util.py", line 715, in call_subprocess
% (command_desc, proc.returncode, cwd))

InstallationError: Command python setup.py egg_info failed with error code 1 in /tmp/pip_build_root/matplotlib

Pero lo corregi con esto: apt-get install libfreetype6-dev , seguramente muchos de los que prueban o probaran su sistema no tienen esa dependencia por defecto y les saltará este problema.

Saludos!.

Include text search in different platforms

Something that may also be useful for the people performing investigations is to let the users use the API of the different platforms to perform searches on user profiles based on text. This applies to Skype accounts, but also to Twitter, Facebook or similar services.

Ebay platform is reported not to be working

The ebay platform seems not recognize the self.notFoundText["usufy"] tag. Tests on certain machines work, so it may be an issue linked to the language of the error.

Original report at issue #32.

Giving the chance of launching the usufy method for each platform separately

There is an issue with demo versions that only show 12 entities per executed transform. Thus, when launchng big transforms some results are usually missing. The issue may be partially solved by letting the user to launch the transforms separetely in a group. For instance: only twitter, facebook, github, etc.

Show platforms which need credentials when launching usufy.py

Till now, the user is not noticing that some queries are not being performed because no credentials have been provided in the config_credentials.py. A message can be shown to let them know that some profiles need to be created in the config_credentials.py.

Mailfy is not working on Windows

Mailfy is currently not working on Windows systems throwing false positives and unreal results. This is because of the use of python-emailahoy library which is not working properly on Windows. This issue has to be revisited so as to check if a more modern implementation does the trick.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.