Web Scraping Tutorial with Scrapy and Python for Beginners

Web scraping is the process of scraping websites and extracting desired data from them, and in this course, you will learn and master web scraping using Python and Scrapy with a step-by-step and in-depth guide.

The course starts with introducing you to the web scraping process (with infographics—no code); learn how to scrape data from websites and how to use Scrapy for this. After getting the basics clear, you will perform web scraping using Python and the Scrapy framework! After you have built an actual web scraper, you will get an idea of how web scraping works first-hand. You will then look at the essential concepts of web scraping and Scrapy. Learning how to scrape websites and the essentials already makes you a complete web scraper but you will take this even further and learn the advanced web scraping techniques to become an expert.

Advanced topics such as crawling multiple pages and extracting data—pagination, scraping data using Regular Expressions (RegEx), scraping dynamic or JavaScript-rendered websites using Scrapy Playwright—will be thoroughly explained. Finally, you will perform three projects at the end—Champions League Table [ESPN], Product Tracker [Amazon], and Scraper Application [GUI].

By the end of this course, you will have learned how to do web scraping using Python and Scrapy.

All the resource files are added to the GitHub repository at:
https://github.com/PacktPublishing/Web-Scraping-Tutorial-with-Scrapy-an…-

Type
video
Category
Programming
publication date
2022-11-25
what you will learn

Send a request to a URL to scrape websites using Scrapy Spider
Get the HTML Response from the URL and parse it for web scraping
Use Scrapy shell commands to test and verify CSS Selectors or XPath
Export and save scraped data to online databases such as MongoDB
Scrape data from multiple web pages using Scrapy pagination
Login to websites using Scrapy FormRequest with CSRF tokens

duration
456
key features
A well-balanced and structured course with practical projects at the end * Scrape Champions League Table [ESPN], Product Tracker [Amazon], and build Scraper Application [GUI] * Bite-sized videos and comes bundled with all the requisite materials
approach
This course is carefully divided into four parts and each video is comprised of bite-sized lessons. The first part focuses on a step-by-step understanding of web scraping from scratch. The second part focuses on the essentials of web scraping and Scrapy. The third part focuses on mastering web scraping and the final part focuses on completing three live real-world projects.
audience
This course is ideal for beginner Python developers who want to master web scraping or freelance web scrapers looking to polish their skills. Any individual and college students working on their projects and wanting to master web scraping using Python and the Scrapy module, then this course is for you. A basic understanding of Python programming is a must and elementary-level knowledge of HTML basics will be a plus but not mandatory.
meta description
Join this comprehensive course where you will learn about web scraping using Python and Scrapy with the help of a step-by-step and in-depth guide from scratch. You will master the process of extracting data from websites.
short description
Assuming that you don’t know anything about web scraping, Scrapy, Python, web scraping, or even the meaning of web scraping—the author starts from the complete basics.

A well-balanced course with theory and practical content followed by three projects at the end ensures you have the right skills to learn scraping.
subtitle
Master web scraping using Scrapy framework with a well-structured web scraping guide for beginners
keywords
Web Scraping, scraping, Scrapy, Python, website, dynamic website scraping, PyCharm 2021.1.3, Visual Studio Code 2022, Python 3.10 and 3.8, Scrapy 2.6.1, Windows 10, Ubuntu 20.0.2, MongoDB 5.0.2, Scrapy-playwright 0.0.12, JSON, CSV, XLSX (Excel), XML
Product ISBN
9781804615317