Learn how to perform web scraping with Python using the Beautiful Soup library.
✏️ Tutorial by JimShapedCoding. Check out his YouTube Channel:
🔗 You can get code snippets here:
⭐️ Course Contents ⭐️
Local HTML Scraping:
⌨️ (00:00) Basic HTML Structure, HTML Tags Explanation
⌨️ (05:35) Packages Installation
⌨️ (07:23) Scraping Usage, Local files
⌨️ (12:41) Beautiful Soup find & find_all() methods
⌨️ (16:22) Web Browser Inspect tool
⌨️ (18:30) Grab all Prices, Basic Scraping Project
Website Scraping:
⌨️ (24:48) Using the Requests Library to see a Website's HTML
⌨️ (30:10) Scraping a Production Website, Best practices for pulling info
⌨️ (44:05) Looping through similar soup.find_all() objects
Features addition:
⌨️ (48:26) Prettifying the Jobs paragraph
⌨️ (54:05) Jobs Filtration by owned skills
⌨️ (57:45) Setting up the Project to scrape every 10 minutes
⌨️ (1:01:53) Storing the jobs paragraph in text files
⭐️ Special thanks to our Champion supporters! ⭐️
🏆 Loc Do
🏆 Joseph C
🏆 DeezMaster
—
Learn to code for free and get a developer job:
Read hundreds of articles on programming:
And subscribe for new videos on technology every day:
Thanks to FCC for posting my Web Scraping course.
This is a huge achievement for me as a consistent learner from this channel 🙂
I hope to see you all around in my future uploads!
DO YOU REALIZE how helpful this is??? you’re amazing!! subbed to your actual channel as well 😀
Jim thank you so much for your time and sharing 🙂
Really good job ！so clean and so specific thankyou❤
Thank you for this course. This was great and well explained.
Great Explanation . Great tutor . Explained each and everything in very simple and logical way . You deserve my salute for this lecture SIR !
The amount of hard work and dedication you guys put to create such free content is just Amazing!!!
Just wanted to say thank you! One of the best tutorials that I have seen on webscraping, and very easy to understand and follow. Great Job!
This is definitely one of the best hours I spent on YouTube. Quality content for free. We don’t deserve this…
If you took the time to finish and learn, then you DO deserve it!
Well said Diego!
@Uvais Hassan and @Diego Guisasola I agree with both of you! Your comments are deep! 💡
You don’t deserve this. Speak for yourself.😬😬😵💫
@Richard G Buchanan Jr. exactly
I see some comments about people receive none from scraping responses, unfortunately it might be expected from websites that are dynamically changed and being updated, there is a great chance that the website had some updates in this 4-month span, and then it affects your results. Try to scrape differently by inspecting to the elements like I show in the website user interface 🙂
yoyo ma
Hi @JimShapedCoding I tried your way of scrapping website but I am getting empty list for whatever tags I give. Can you please share why this is happening?
@Asma Akram some of sites are locked for doin this in easy way
Hocam Türk müydünüz selamlar
For me i copied the html file wrongly from his github. Make sure to to open the page in a browser to make sure you’ve copied it correctly.
I just have to say, this is the best webscraping course I have seen so far. Very well done !
This was amazing, I didn’t know web scraping could be so easy
I thought this skill would be way above my level as i’m still a student mid way through my under-graduate , but you guys made it look like a child’s play. I’m actually able to do web scraping after watching your video. Well done FCC team , good job boys💪🔥.
Absolutely brilliant course. An excellent introduction to web scraping and how python programmers solve problems. Well done.
I have to give a big thumb up for this tutorial!!!! Very well explained, easy to understand and great pace! I hope to see more tutorials from this teacher. Thanks!!!
this is what I call quality content. Very logically presented and instructed. Thank you very much for contributing to my future’s success in Python.
Excellent tutorial for a total web scraping novice, after watching this I’m already able to pull data from several different websites for my own use case. Knowing very little html coming in, I already feel like I know enough to get to some useful information to analyze offline. Very easy to follow and a great flow by the presenter Jim. Thank you.
37:25 we can also use strip function instead of replace
Just a suggestion @37:09 it is better to use text.strip() method to remove unnecessary space from the beginning and the end. replace removes spaces from the company name as well.
Thank you! This was a great introduction for a total beginner to scraping. By the end of it, I was able to use what you taught me on a different website, and I’m starting a scraping project now with what I just learned.
Voww voww voww. I loved this tutorial. Followed from beginning to end. I liked it that you put the filtering condition while scraping the data, extra features and all. Just awesome. This is a must watch for all beginners. Huge thanks to both Jim and FCC
Link to the home.html file: https://github.com/jimdevops19/codesnippets/tree/main/Python%20Web%20Scraping/01%20-%20Scraping%20Basics
Alternatively if you want to be safer and you’re worried about that link, go to his official website and navigate to get to the same website:
http://www.jimshapedcoding.com/
Great video! Great tutorial! Great teacher! You have explained it very clearly, thank you!
Great Explanation . Great tutor . Explained each and everything in very simple and logical way . You deserve my salute for this lecture SIR !
Just 15 minutes into the course and I’m already feeling like a web scraping pro 😊😊. Thank you so much