maturner5/turtlescrape

turtlescrape is a very simple project to turn web scraping from multiple lines of code down into just one line by using BeautifulSoup4 in the background.

turtlescrape

This is a very simple project written in Python 3.8.5 to make scraping websites easier so you don't have to type all of the code for the library yourself.

This project uses these libraries: BeautifulSoup4, urllib.request and sys.

Install

Command:

pip install turtlescrape

You must also have BeautifulSoup4 installed.

Usage

Right now this project only has one function: turtlescrape().

To call it simply

from __init__ import turtlescrape

turtlescrape(url, *args, **kwargs)

Look at the example project in order to get a feel for it.

Notice

This project is most definetly broken in ways. But we all start somewhere, so input is definetly appreciated.

Not all websites let you scrape them. I have yet to figure out a workaround for that problem so in the meantime this code just throws up an error.

turtlescrape's Issues

Issue with calling the module into a program.

Currently to call the module into your program you must write it like this:

from __init__ import turtlescrape

I know this is wrong, but I don't know how I can change it to something like this:

from turtlescrape import turtlescrape

which is much better, as that is similar to how normal modules are called in python.

Any help would be much appreciated :)