It really is as cool as it seems.
🔧 Technical Terms
Web scraping is a term used for scraping data off websites using code. Think of a list of products and prices - then putting that data into a spreadsheet, CSV, or database.
There is a ton of tools out there, especially in coding. But here is a list of things you will need to start web scraping.
📚 Libraries: Pandas (database) and Beautiful Soup (web scraping)
👩💻 Code Editor: VS Code
📁 Code Storage: Git and GitHub
You actually need to know more than just Python. Here is a list of skills you may need to brush up on.
👩💻 Python: Importing libraries
🐼 Pandas: Converting to a CSV
🍲 Beautiful Soup: Finding elements
🌐 HTML: Types of elements (div, span, p)
🎨 CSS: Classes
🌎 Real World Application
There are websites filled with cost information like Platt, an electrical parts website. You might want to stick all these items and their prices into an excel spreadsheet.
👩💻 My Code
Here is my base code in order to start web scraping. You can edit the baseURL variable as needed for other websites. Then you need to inspect the code on their website to see how they tagged(through CSS classes) the HTML element you want to grab.
I just finished filming a video on web scraping. It will come out next Monday. I walk through the exact code I wrote!