scrapy-azuresearch-crawler-samples

Scrapy as a Web Crawler for Azure Search Sample

Samples

• quotes: Web Scraping Quotes to Scrape's quote list and indexing them with Azure Search
• craigslist: Web Scraping Craigslist's Jobs in Tokyo and indexing them with Azure Search
• unofficialism: Web Scraping Unofficialism's all blog articles and indexing them with Azure Search

Tips

• Scrapy.org
• Scrapy Totorial
• Welcome to Azure Cosmos DB
• What is Azure Search?
• Azure Search Indexer Overview
• Connecting Cosmos DB with Azure Search using indexers

Contributing

Bug reports and pull requests are welcome on GitHub at https://github.com/yokawasa/scrapy-azuresearch-crawler-samples