morvanzhou/easy-scraping-tutorial

Simple but useful Python web scraping tutorial code.

easy-scraping-tutorial's Issues

d_jan

In [3]:
jan = soup.find('ul', {"class": 'jan'})
d_jan = jan.find_all('li') # use jan as a parent --> this cannot work, jan is a list already.
for d in d_jan:
print(d.get_text())
一月一号
一月二号
一月三号

The code doesn't work

In the code of requests.post().
I don't why you code can only print('Hello there, !') even change Chinese into English.

data = {'firstname': '莫烦', 'lastname': '周'}
r = requests.post('http://pythonscraping.com/files/processing.php', data=data)
print(r.text)
# Hello there, 莫烦 周!

Best Wish!

运行4-1distributed scraping 报错

Distributed Crawling...

Distributed Parsing...
multiprocessing.pool.RemoteTraceback:
"""
Traceback (most recent call last):
File "C:\PYTHON\lib\multiprocessing\pool.py", line 125, in worker
result = (True, func(*args, **kwds))
File "D:\sublime\mofan爬虫教程\4-1-distributed-scraping.py", line 18, in parse
page_urls = set([urljoin(base_url, url['href']) for url in urls]) # remove duplication
File "D:\sublime\mofan爬虫教程\4-1-distributed-scraping.py", line 18, in
page_urls = set([urljoin(base_url, url['href']) for url in urls]) # remove duplication
NameError: name 'base_url' is not defined
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "4-1-distributed-scraping.py", line 49, in
results = [j.get() for j in parse_jobs] # parse html
File "4-1-distributed-scraping.py", line 49, in
results = [j.get() for j in parse_jobs] # parse html
File "C:\PYTHON\lib\multiprocessing\pool.py", line 771, in get
raise self._value
NameError: name 'base_url' is not defined

Repl Closed

Do you know the reason why the scrap keeping looping from 呼损率 to 服务等级?

Scrapy