# Crawl **Repository Path**: litanet/Crawl ## Basic Information - **Project Name**: Crawl - **Description**: Learning Spider Project - **Primary Language**: Python - **License**: Not specified - **Default Branch**: master - **Homepage**: None - **GVP Project**: No ## Statistics - **Stars**: 0 - **Forks**: 0 - **Created**: 2020-06-08 - **Last Updated**: 2020-12-19 ## Categories & Tags **Categories**: Uncategorized **Tags**: None ## README # Crawl This Project is used to store crawl program. ## tjnuNews program **tjnuNews** was seted up by **Scrapy** Framework,you can use this program to get news from Tianjin Normal university.
Here are a few things you need to know:
* Set Up Scrapy Framework:```pip install scrapy``` * Create Scrapy Framework:```scrapy startproject tjnu``` * Create Spider Program :```scrapy genspider tjnunews tjnu.edu.cn``` * Run Spider program:```scrapy crawl tjnunews -o tjnu.csv```
## tjnu program >**tjnu** program is also based on the Scrapy framework, which mainly provides multi-page scraping examples. Upload Date:2020/4/2 ## icourse_ajaxspider.py > This project is used to give a demo to scrapying the webpages that being render by **ajax**. Upload Date:2020/4/14