The Ultimate Introduction to Web Scraping and Browser Automation

Whenever you need to import data from an external website, hopefully they provide an API and make your life easy. But in the real world, that's not always the case. There are numerous reasons why you might want to get data from a web page or multiple web pages, and there's no API in sight, and in that case you're going to need to fall back onto Web Scraping and Browser Automation. In this screencast I'm going to give a high level overview of how to scrape websites, then cover five different scenarios, in increasing difficulty, for practical web scraping. There is a massive amount of information in this screencast and I'm going to straight up bombard you with it, but if you can make it until the end I guarantee you will come out knowing how to scrape websites with the best of them. As always, you can hit me up on twitter @AlwaysBCoding with questions, comments, to argue about programming, or to drop a suggestion for which topics I should cover next.

• #science_technology
• #web_scraping
• #browser_automation
• #nokogiri
• #selenium
• #watir
• #phantomjs
• #web_scraping_ruby
• #browser_automation_ruby
• #how_to_scrape_websites
• #web_scrape
• #automate_browser
• #how_to_scrape_data
• #browser_scraping
• #program_browser
• #practical_web_scraping
• #install_selenium
• #how_to_use_nokogiri
• #how_to_use_watir
• #web_scraping_tutorial