WebScraping with Autohotkey 101-Pointer and getting values from page
20.4 هزار بار بازدید -
9 سال پیش
-
In this beginning WebScraping with
In this beginning WebScraping with AutoHotkey tutorial I demonstrate how to use AutoHotkey and IE (via COM) to: 1) get a pointer to IE 2) navigate to a page 3) get text from a page. Webscraping with AutoHotkey is easy!
The script I demo writing the syntax can be found here:
https://the-automator.com/web-scrapin... https://the-automator.com/web-scrapin...
TLDR: The key idea of the video is to provide a tutorial on web scraping using Autohotkey, focusing on using Amazon as an example and emphasizing the importance of understanding web scraping resources and techniques.
1. 00:00 📹 This tutorial covers the basics of web scraping using Autohotkey, with a focus on using Amazon as an example and emphasizing the importance of resources like Jethro's tutorial and w3 schools for understanding web scraping.
1.1 This tutorial covers the fundamentals of automating web scraping using Autohotkey and the component object module from Microsoft, with the speaker emphasizing their non-programmer background and ability to explain concepts in layman's terms.
1.2 The video demonstrates how to use Autohotkey for web scraping, specifically using Amazon as an example.
1.3 The video discusses the importance of resources like Jethro's tutorial and w3 schools for understanding web scraping, and introduces the IWebBrowser tool for grabbing information from webpages.
2. 03:22 📝 Understanding the hierarchy of elements on a webpage is crucial for web scraping, and in this video, the speaker demonstrates how to get a pointer to the current Internet Explorer window for scraping with Autohotkey.
2.1 The transcript discusses the hierarchy of elements on a webpage and the importance of understanding the parent structure when web scraping.
2.2 To perform web scraping with Autohotkey, you need to create or get a pointer to an Internet Explorer object, and in this example, the speaker demonstrates getting a pointer to the current IE window.
3. 05:45 📹 The speaker shows how to store and display variable locations, delete unnecessary code, and retrieve values from webpages using unique IDs, arrays, and element names in Autohotkey web scraping.
3.1 The speaker demonstrates how to store and display the location of a variable, and then explains how to delete unnecessary code while keeping a specific function in the script.
3.2 The speaker demonstrates how to retrieve the value of an input box with a specific ID using web scraping in Autohotkey.
3.3 The speaker demonstrates how to retrieve values from a webpage using a unique ID, an array with dashes in the name, or by getting elements by name.
4. 09:23 📝 Use tag names to get values from a webpage, but be cautious as it may become unstable if the page changes; speaker emphasizes the importance of observing consistency in selected and unselected inputs.
4.1 Use the tag name to get values from a webpage, but be aware that it may not be stable if the page changes.
4.2 The speaker discusses changing values and observing the consistency of selected and unselected inputs.
5. 12:28 📹 The speaker shows how to select values from a webpage's drop-down box using Autohotkey, explaining how to retrieve index numbers and actual values, as well as extract HTML values and text from the page.
5.1 The speaker demonstrates how to select values from a drop-down box on a webpage using Autohotkey.
5.2 The speaker explains how to retrieve different values from a webpage using Autohotkey, demonstrating how the index number and the actual value can be obtained.
5.3 The speaker demonstrates how to extract HTML values from a webpage using Autohotkey, including grabbing the outer HTML, finding options within it, and getting all the text on the page.
6. 16:42 📹 The speaker shows how to use Autohotkey to scrape and retrieve links from a webpage, including link count, text, and outer HTML, addressing the problem of programmatically navigating to a page.
6.1 The speaker demonstrates how to use Autohotkey to scrape and retrieve all the links on a webpage, displaying the link count, text, and outer HTML for each link.
6.2 The video discusses the problem of navigating to a page programmatically and not being able to find a way.
7. 18:50 📹 The speaker shows how to pause and wait for page loading using a while loop in Autohotkey, as well as how to navigate browser history.
7.1 The speaker demonstrates how to pause the page loading process and wait for it to finish using a while loop in Autohotkey.
7.2 The speaker demonstrates how to navigate backward and forward in browser history using Autohotkey.
8. 21:15 📝 The video demonstrates how to extract specific information from a webpage using web scraping techniques in Autohotkey.
The script I demo writing the syntax can be found here:
https://the-automator.com/web-scrapin... https://the-automator.com/web-scrapin...
TLDR: The key idea of the video is to provide a tutorial on web scraping using Autohotkey, focusing on using Amazon as an example and emphasizing the importance of understanding web scraping resources and techniques.
1. 00:00 📹 This tutorial covers the basics of web scraping using Autohotkey, with a focus on using Amazon as an example and emphasizing the importance of resources like Jethro's tutorial and w3 schools for understanding web scraping.
1.1 This tutorial covers the fundamentals of automating web scraping using Autohotkey and the component object module from Microsoft, with the speaker emphasizing their non-programmer background and ability to explain concepts in layman's terms.
1.2 The video demonstrates how to use Autohotkey for web scraping, specifically using Amazon as an example.
1.3 The video discusses the importance of resources like Jethro's tutorial and w3 schools for understanding web scraping, and introduces the IWebBrowser tool for grabbing information from webpages.
2. 03:22 📝 Understanding the hierarchy of elements on a webpage is crucial for web scraping, and in this video, the speaker demonstrates how to get a pointer to the current Internet Explorer window for scraping with Autohotkey.
2.1 The transcript discusses the hierarchy of elements on a webpage and the importance of understanding the parent structure when web scraping.
2.2 To perform web scraping with Autohotkey, you need to create or get a pointer to an Internet Explorer object, and in this example, the speaker demonstrates getting a pointer to the current IE window.
3. 05:45 📹 The speaker shows how to store and display variable locations, delete unnecessary code, and retrieve values from webpages using unique IDs, arrays, and element names in Autohotkey web scraping.
3.1 The speaker demonstrates how to store and display the location of a variable, and then explains how to delete unnecessary code while keeping a specific function in the script.
3.2 The speaker demonstrates how to retrieve the value of an input box with a specific ID using web scraping in Autohotkey.
3.3 The speaker demonstrates how to retrieve values from a webpage using a unique ID, an array with dashes in the name, or by getting elements by name.
4. 09:23 📝 Use tag names to get values from a webpage, but be cautious as it may become unstable if the page changes; speaker emphasizes the importance of observing consistency in selected and unselected inputs.
4.1 Use the tag name to get values from a webpage, but be aware that it may not be stable if the page changes.
4.2 The speaker discusses changing values and observing the consistency of selected and unselected inputs.
5. 12:28 📹 The speaker shows how to select values from a webpage's drop-down box using Autohotkey, explaining how to retrieve index numbers and actual values, as well as extract HTML values and text from the page.
5.1 The speaker demonstrates how to select values from a drop-down box on a webpage using Autohotkey.
5.2 The speaker explains how to retrieve different values from a webpage using Autohotkey, demonstrating how the index number and the actual value can be obtained.
5.3 The speaker demonstrates how to extract HTML values from a webpage using Autohotkey, including grabbing the outer HTML, finding options within it, and getting all the text on the page.
6. 16:42 📹 The speaker shows how to use Autohotkey to scrape and retrieve links from a webpage, including link count, text, and outer HTML, addressing the problem of programmatically navigating to a page.
6.1 The speaker demonstrates how to use Autohotkey to scrape and retrieve all the links on a webpage, displaying the link count, text, and outer HTML for each link.
6.2 The video discusses the problem of navigating to a page programmatically and not being able to find a way.
7. 18:50 📹 The speaker shows how to pause and wait for page loading using a while loop in Autohotkey, as well as how to navigate browser history.
7.1 The speaker demonstrates how to pause the page loading process and wait for it to finish using a while loop in Autohotkey.
7.2 The speaker demonstrates how to navigate backward and forward in browser history using Autohotkey.
8. 21:15 📝 The video demonstrates how to extract specific information from a webpage using web scraping techniques in Autohotkey.
9 سال پیش
در تاریخ 1394/03/03 منتشر شده
است.
20,463
بـار بازدید شده