This path transforms you from a curious beginner to a pro in web scraping with Python and Beautiful Soup. Starting with basic techniques, you will progress to advanced concepts such as handling links and processing data efficiently.
What you'll learn
Send HTTP requests and handle webpage responses with Python
Parse HTML content using Beautiful Soup
Navigate webpage structures and select relevant elements
Extract, organize, and save text, links, images, and tabular data
Handle pagination to collect data from multiple pages
Build scalable and optimized scripts for structured web data extraction
Advantages and disadvantages
Advantages
University courses you can audit for free, with lectures, readings and practice quizzes.
A verified certificate from the university if you pay for it.
Self-paced: start any time.
Disadvantages
Graded assignments and the certificate need the paid track.
Audit access can expire a few weeks after the course ends.
Learning is free, but the certificate costs money.
Some parts (graded work, certificate) are paid.
Some points apply to every course of this kind; see how we rank.
Free to audit
Free: Choose "Audit this course" when you enrol: lectures, readings and practice are free.
Paid: Graded assignments and the verified certificate (Certificate $65). Audit access may end after the course closes.
Before you start
Beginner: Server-Side Programming (Beautiful Soup, Python)
Beginner: HTML and CSS Fundamentals
This is CS50P, CS50's Introduction to Programming with Python. Register for free at https://cs50.edx.org/python. Slides and source code at https://cs50.harvard.edu/python. Playlist at https://www.youtube.com/playlist?list=PLhQjrBD2T3817j24-GogXmWqO5Q5vYy0V. An introduction to programming using a la…
Instructor: Ana Bell View the complete course: https://ocw.mit.edu/courses/6-100l-introduction-to-cs-and-programming-using-python-fall-2022/ *Note: Lectures 6, 10 have been updated! This subject is aimed at students with little to no programming experience. It aims to provide students with an under…
This is CS50W, CS50's Web Programming with Python and JavaScript. Register for free at https://cs50.edx.org/web. Slides and source code at https://cs50.harvard.edu/web. This course picks up where Harvard University’s CS50 leaves off, diving more deeply into the design and implementation of web apps…
This course explores the concepts and algorithms at the foundation of modern artificial intelligence, diving into the ideas that give rise to technologies like game-playing engines, handwriting recognition, and machine translation. Through hands-on projects, students gain exposure to the theory beh…
This course explores the concepts and algorithms at the foundation of modern artificial intelligence, diving into the ideas that give rise to technologies like game-playing engines, handwriting recognition, and machine translation. Through hands-on projects, students gain exposure to the theory beh…
View the complete course: http://ocw.mit.edu/18-S997F11 Instructor: Yossi Farjoun This course is intended to assist undergraduates with learning the basics of programming in general and programming MATLAB® in particular. License: Creative Commons BY-NC-SA More information at http://ocw.mit.edu/term…