siu91/easy_university_selection

一个抓取全国高校历年在各地区的入取分数线的项目，用于高考学生筛选学校

Hi，我是 Siu 🇨🇳 👋

• 🔭 当前正在做一些数仓选型架构类的工作，关注 Doris/TiDB
• 🌱 写 Java 恰饭，正在接受 Rust “再教育”
• 📫 没事给我发邮件: [email protected]
• 🎭 喜欢 RSS ，Google Reader 已死，希望 RSS 永存

❤️ 一些代码和笔记

• 📖 Learn Rust the hard way(doing)
• ➿ Some code：
  • myboot : SpringBoot 脚手架
  • rukawa: 一个简单的动态数据源库（Java）
• 📒 Some notes or best practices：
  • Application Architecture Archetype：应用架构原型，DDD、CQRS、COLA 的一些实践
  • Share my list of software tools
  • Java 后端选型指北(to be done)
  • Real-time Data Warehouse: 实时数仓 POC
  • cicd: 构建基于 Jenkins、Jenkins Pipeline Library 的 CI/CD 平台
  • PostgreSQL HA: 基于 pg_auto_failover 的 PG 高可用方案
  • jrudf: Doris 远程 UDF 的设计/开发指北
  • Flyway Usage Guide: flyway 数据库自动化的规范和最佳实践
  • Semver2.0 practice
  • Restful API Design Guidelines：Restful API 设计规范
  • How to Code Review
• 😸 Java-er ♨️ & Love Rust & Love RSS

​

easy_university_selection's Issues

求助，抓取的url好像有问题

尝试跑了一下，有http的报错

python2.7 ./easy_university_selection.py 10010 10035 512 2018 10148

好像是抓取的链接根本不存在的问题
在gkcx.eol.cn找了很久也没找到该怎么改

http://gkcx.eol.cn/schoolhtm/scores/provinceScores643_10010_10035_10036.xml

python2.7 ./easy_university_selection.py 10010 10035 512 2018 10148
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
年份：2018
地区：山西
分数：512 理科
过滤：专科
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
加载高校库完成，共有2766所高校信息载入
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
抓取高校库中所有高校在[山西]地区[理科]招生分数线
http://gkcx.eol.cn/schoolhtm/scores/provinceScores643_10010_10035_10036.xml
Traceback (most recent call last):
File "./easy_university_selection.py", line 679, in
spider_university_province_score_line('10036', '本一批次')
File "./easy_university_selection.py", line 384, in spider_university_province_score_line
'http://gkcx.eol.cn/schoolhtm/scores/provinceScores', 'provinceScores', tier, info)
File "./easy_university_selection.py", line 406, in spider_score_line
res_data = urllib2.urlopen(req)
File "/usr/lib/python2.7/urllib2.py", line 154, in urlopen
return opener.open(url, data, timeout)
File "/usr/lib/python2.7/urllib2.py", line 435, in open
response = meth(req, response)
File "/usr/lib/python2.7/urllib2.py", line 548, in http_response
'http', request, response, code, msg, hdrs)
File "/usr/lib/python2.7/urllib2.py", line 467, in error
result = self._call_chain(*args)
File "/usr/lib/python2.7/urllib2.py", line 407, in _call_chain
result = func(*args)
File "/usr/lib/python2.7/urllib2.py", line 654, in http_error_302
return self.parent.open(new, timeout=req.timeout)
File "/usr/lib/python2.7/urllib2.py", line 435, in open
response = meth(req, response)
File "/usr/lib/python2.7/urllib2.py", line 548, in http_response
'http', request, response, code, msg, hdrs)
File "/usr/lib/python2.7/urllib2.py", line 473, in error
return self._call_chain(*args)
File "/usr/lib/python2.7/urllib2.py", line 407, in _call_chain
result = func(*args)
File "/usr/lib/python2.7/urllib2.py", line 556, in http_error_default
raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)
urllib2.HTTPError: HTTP Error 500: Internal Server Error

网站结构变了

网站结构变了

404是不是网站改了

'http://gkcx.eol.cn/schoolhtm/scores/provinceScores31_10016_10035_10036.xml'

Traceback (most recent call last):
File "C:/Users/Administrator.DESKTOP-DHPJ48Q/Desktop/easy_university_selection-master/aaa.py", line 10, in
response = urllib2.urlopen(req)
File "D:\Python27\Lib\urllib2.py", line 154, in urlopen
return opener.open(url, data, timeout)
File "D:\Python27\Lib\urllib2.py", line 435, in open
response = meth(req, response)
File "D:\Python27\Lib\urllib2.py", line 548, in http_response
'http', request, response, code, msg, hdrs)
File "D:\Python27\Lib\urllib2.py", line 467, in error
result = self._call_chain(*args)
File "D:\Python27\Lib\urllib2.py", line 407, in _call_chain
result = func(*args)
File "D:\Python27\Lib\urllib2.py", line 654, in http_error_302
return self.parent.open(new, timeout=req.timeout)
File "D:\Python27\Lib\urllib2.py", line 435, in open
response = meth(req, response)
File "D:\Python27\Lib\urllib2.py", line 548, in http_response
'http', request, response, code, msg, hdrs)
File "D:\Python27\Lib\urllib2.py", line 473, in error
return self._call_chain(*args)
File "D:\Python27\Lib\urllib2.py", line 407, in _call_chain
result = func(*args)
File "D:\Python27\Lib\urllib2.py", line 556, in http_error_default
raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)
urllib2.HTTPError: HTTP Error 404: Not Found

syntaxerror

(base) PS C:\Users\TS3\Desktop\easy_university_selection-master> python ./easy_university_selection.py 10024 10034 393 2
017 10148
File "./easy_university_selection.py", line 156
print '共加载' + str(len(d)) + '条专业分数线数据'
^
SyntaxError: invalid syntax

請問一下這是什麽問題0.0