scrapy网络爬虫视频教程

pip install scrapy

scrapy startproject myproject

import scrapyclass MySpider(scrapy.Spider):    name = 'myspider'    start_urls = ['https://example.com']    def parse(self, response):        for quote in response.css('div.quote'):            yield {                'text': quote.css('span.text::text').get(),                'author': quote.css('span.author::text').get(),            }

scrapy crawl myproject.myspider -o quotes.csv