Better Web Scraping with Mechanical Soup - Build a Database of Cat and Dog Photos in 10 minutes
43 هزار بار بازدید -
4 سال پیش
-
In this videos we'll discuss
In this videos we'll discuss the benefits of using Mechanical Soup over Beautiful Soup for web scraping, and show a few handy examples in code.
The end result of this tutorial would be a local database of cat and dog photos, created from scratch in LESS THAN 10 MINUTES!
We'll completely automate the process of searching for images on Google, downloading them and saving them to a new local directory. We'll scrap the HTML code from a few web pages at a time and create a very efficient searching process for any desired term.
Well need the help of mechanicalsoup, os and wget modules to achieve these results, and a basic level of Python knowledge is recommended for the viewer.
Mechanical Soup Documentation:
https://mechanicalsoup.readthedocs.io...
Check out the code on Github:
https://github.com/MariyaSha/BetterWe...
Connect with me on LinkedIn:
www.linkedin.com/in/mariyasha888/
The end result of this tutorial would be a local database of cat and dog photos, created from scratch in LESS THAN 10 MINUTES!
We'll completely automate the process of searching for images on Google, downloading them and saving them to a new local directory. We'll scrap the HTML code from a few web pages at a time and create a very efficient searching process for any desired term.
Well need the help of mechanicalsoup, os and wget modules to achieve these results, and a basic level of Python knowledge is recommended for the viewer.
Mechanical Soup Documentation:
https://mechanicalsoup.readthedocs.io...
Check out the code on Github:
https://github.com/MariyaSha/BetterWe...
Connect with me on LinkedIn:
www.linkedin.com/in/mariyasha888/
4 سال پیش
در تاریخ 1399/03/27 منتشر شده
است.
43,074
بـار بازدید شده