Scrape Any Website using llama3+Ollama+ScrapeGraphAI | Fully Local + Free #ai #llm
12.6 هزار بار بازدید -
4 ماه پیش
-
In a constantly evolving web
In a constantly evolving web landscape, ScrapeGraphAI introduces a new era of web scraping. This open-source library leverages Large Language Models (LLMs) to offer flexible and low-maintenance scraping solutions for developers.
ScrapeGraphAI is a web scraping Python library that uses LLM and direct graph logic to create scraping pipelines for websites and local documents (XML, HTML, JSON, etc.). The SmartScraperGraph class represents one of the default scraping pipelines, utilizing a direct graph implementation where each node has its own function—from retrieving HTML from a website to extracting relevant information based on your query and generating a coherent answer.
In this video, we explore how to scrape website content using LLaMA3, Ollama, and ScrapeGraphAI, all running locally. Note that a minimum of 15GB of RAM is required for this application. This approach can also be applied to your local documents such as XML, HTML, and more.
Let's dive into it!
#WebScraping #PythonLibrary #ScrapeGraphAI #LLM #OpenSource #Tutorial #DataExtraction #LocalDocuments
Blog :www.dataedgehub.com/
LINKS:
Code :www.dataedgehub.com/2024/07/Webscraping-locallm.ht…
GitHub Code: github.com/InsightEdge01/ScrapegraphAIOllamallama3
Ollama download:ollama.com/download
ScrapegraphAI:scrapegraph-ai.readthedocs.io/en/latest/introducti…
ScrapeGraphAI Github: github.com/VinciGit00/Scrapegraph-ai?tab=readme-ov…
• How I built the FASTEST Multiple CSV ...
• How I built a Multiple CSV Chat App u...
• How I built a Multi-PDF Chat App with...
4 ماه پیش
در تاریخ 1403/02/25 منتشر شده
است.
12,604
بـار بازدید شده