crawling IT news site by using Scrapy and Django
- IT λ΄μ€ ν¬λ‘€λ§ μΉμ¬μ΄νΈ λ§λ€κΈ°
β
Scray
λ₯Ό μ΄μ©νμ¬ λ€μ΄λ² IT λ΄μ€λ₯Ό ν¬λ‘€λ§νμ¬ modelμ μ°λλ dbμ μ μ₯
β
django MTV
ν¨ν΄μ μ΄μ©νμ¬ ν¬λ‘€λ§ν λ°μ΄ν°λ₯Ό 보μ¬μ£Όλ μΉμ¬μ΄νΈ ꡬμΆ
β
μ΅μ λ°μ΄ν° κ°μ Έμ€κΈ° button
μ ν΅ν λ΄μ€ ν¬λ‘€λ§
β
ν€μλ μ
λ ₯μ ν΅ν search
κΈ°λ₯ μΆκ°
β
DBμ μ μ₯λ λ°μ΄ν°λ₯Ό μ 곡ν μ μλ RESTful API
μ€κ³
# Scrapy Project
scrapy startproject myscrapy # start scrapy project
scrapy genspider mybot domin # scrapy bot
# Django project
django-admin startproject django-scrapy-news # νλ‘μ νΈ μμ±
python manage.py migrate # db μ μ₯
python manage.py startapp news # λ΄μ€ app μμ±
# λͺ¨λΈ μ€κ³ -> λ·° μ€κ³ -> ν
νλ¦Ώ μ€κ³
project demo show
name | μμΉνπ¨π»βπ» |
---|---|
period | 2021/01/25 ~ 2021/01/29 |
division | stack |
---|---|
Framework | Django |
Front-end | Python, html, css |
Back-end | Python, Scrapy |
db | Sqlite |
Code Management | Git, Github |
IDE | Visual Studio Code |