Comments (7)
@pavankalyan224847 This is open and not assigned to anyone.
from torbot.
If anyone wants to take on this task before I do, here's some context.
You should make use of the LinkTree
class which uses treelib
to construct a tree data structure that can be printed, downloaded use tree operations such as searching the tree.
https://github.com/DedSecInside/TorBot/blob/dev/torbot/modules/linktree.py
Using the class requires passing the root node of the tree and how far you would like the tree to be built, depth-wise
tree = LinkTree(root = "https://www.example.com", depth = 2) # builds tree on instantiation
tree.show() # prints tree to std output
tree.save("test.txt") # saves tree results to `test.txt`
The tree nodes currently only save the URL, but treelib
has a mechanism to extend nodes to store data.
https://treelib.readthedocs.io/en/latest/index.html#advanced-usage
class WebMetadata(object):
def __init__(self, html, headers):
self.html = html
self.headers = headers
# using treelib library
tree = Tree()
resp = requests.get("https://www.example.com")
tree.create_node("root", "root", data=WebMetadata(resp.text, resp.headers)) # passing html and headers
from torbot.
is this issue closed or open ?
from torbot.
This comment #270 (comment) is out of date.
The LinkTree
does still exist but has been refactored completely, you can check out the refactored code here.
https://github.com/DedSecInside/TorBot/blob/dev/torbot/modules/linktree.py
Let me know if you have any questions.
from torbot.
can you assign this to me i would like to work on it
from torbot.
@pavankalyan224847 Done!
from torbot.
Updates?
from torbot.
Related Issues (20)
- installation issue HOT 1
- TorBot not searching onion sites HOT 1
- Move log level from environment variable to CLI flag HOT 12
- Connection Refuse Error HOT 1
- TorBot Installation Issue HOT 3
- Help Us Enhance Tests! HOT 4
- Move pull request template HOT 1
- Move markdown files to a docs directory HOT 2
- Add HTML feature HOT 20
- Save links to a database HOT 3
- Add keyword/phrase search HOT 1
- Create docker image HOT 4
- [Docs]:- Adding Contributors Section to the readme.md HOT 4
- Move socks5 env variables to CLI flags
- [SSL: WRONG_VERSION_NUMBER] wrong version number (_ssl.c:1006) HOT 12
- Feature: Adding contributors section to the README.md file. HOT 4
- Only get the original link when crawling onion sites HOT 10
- UnicodeDecodeError 'charmap'
- Launching with Python3.9 fails with TypeError
- Can't actually find the bug to correct it.
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from torbot.