Hi there & welcome to the most advanced online resource on Web Scraping with Python using Scrapy & Splash. This course is fully project–based means pretty much on each section we gonna scrape a different website & tackle a different web scraping dilemma also rather than focusing on the basics of Scrapy & Splash we gonna dive straight forward into real–world projects, this also means that this course is absolutely not suitable for beginners with no background on web scraping, Scrapy, Splash & XPath expressions.
–This courses covers a variety of topics such as: –
Requests chaining, like how the requests must be sent in a certain order otherwise they won’t be fulfilled at all.
How to analyze a website before scraping it, this is an important step to do since it helps a lot in choosing the right tools to scrape a website & it literally has a huge impact on the performance of your final product.
How to optimize Splash scripts by reducing/aborting all the unnecessary requests that have nothing to do with the data points you’re going to scrape, this is an important thing to do if you care about the performance of Splash as it is the key to bypass 504 Gateway Timeout HTTP errors in Splash.
Courses : 3
Specification: Advanced Web Scraping with Python using Scrapy & Splash
7 reviews for Advanced Web Scraping with Python using Scrapy & Splash