Python Web Scraping Tutorial. Use BeautifulSoup & Requests to scrape & crawl the Craigslist directory with Python
Free tutorial
47,958 students
31min of on-demand video
Created by GoTrained Academy
English
English [Auto]
Current priceFree
What you’ll learn
- Installing Python Web Scraping libraries, BeautifulSoup & Requests.
- Extracting URLs from a webpage.
- Scraping text data from a webpage.
- Crawling multiple webpages and scraping data from each of them.
- Handling navigation links and move to next pages.
- Saving scraped data into a CSV file with Pandas.
- Overview about other popular web scraping frameworks.
Requirements
- Basic knowledge of Python programming
Description
Q. Do you want to extract data from a specific website but it takes a lot of time doing so manually?
A. Web Scraping is the process of automating data extraction from websites.
Q. Do you see many Web Scraping jobs, but you do not feel confident enough to apply?
A. This Web Scraping tutorial will teach you how web scrape a real-life project from a to z.
When the webpage structure is so complicated, making it difficult to extract specific pieces of data, or when you need to open so many pages to extract data from each of them, the manual process can become boring and time-wasting, and that is when automated Web Scraping can make the process more efficient and effective.
In this Web Scraping tutorial:
- Grasp Python Web Scraping fundamentals.
- Use BeautifulSoup & Requests to scrape & crawl Craigslist with Python
- Learn how to save your scraped output to a CSV / Excel file.
- Understand the difference between Web Scraping Python libraries and frameworks.
So let’s start your Web Scraping real-life project.
Who this course is for:
- Python developers and students who are new to Web Scraping
Show less
Course content
3 sections • 11 lectures • 31m total lengthCollapse all sections
Web Scraping with Python BeautifulSoup & Requests8 lectures • 21min
- Web Scraping Course Overview01:28
- Installing BeautifulSoup & Requests00:58
- URL Extraction03:07
- Web Scraping Craigslist – Titles01:51
- Web Scraping Craigslist – Job Details Wrapper03:27
- Web Scraping Craigslist – Job Description Page02:57
- Crawling & Scraping Next Pages02:36
- Saving Output to CSV File04:22
Final Assignment0 lectures • 0min
- Web Scraping Assignment1 question
Other Web Scraping Python Frameworks Overview3 lectures • 10min
- Scrapy vs. Other Python Web Scraping Libraries09:53
- Scrapy Framework Tutorial: Scraping Craigslist00:07
- Bonus: Advanced Web Scraping Courses00:15
