Evaluating PySpark Machine Learning Model | Hyperparameter Tuning
1.1 هزار بار بازدید -
پارسال
-
Join us in this concise
Join us in this concise and insightful video as we explore the crucial steps of evaluating PySpark machine learning models and optimizing their performance through hyperparameter tuning. Learn essential evaluation metrics and techniques, gain hands-on experience with PySpark's MLlib library, and discover how to select and tune hyperparameters effectively. Whether you're a data scientist or a PySpark user, this guide will help you maximize the performance of your machine learning models. Don't miss out—watch now and take your skills to the next level!
Code for this lecture: https://github.com/ashaypatil11/spark/blob/main/ML_Pipeline.ipynb
Data file used in the lecture: https://github.com/ashaypatil11/spark/blob/main/ML_Data.parquet
-------------------------------------------------------------------------------------------------------------
Anaconda Distributions Installation link:
https://www.anaconda.com/products/distribution
----------------------------------------------------------------------------------------------------------------------
Apache Spark Installation links:
1. Download JDK: https://www.oracle.com/in/java/technologies/downloads/#jdk19-windows
2. Download Python: https://www.python.org/downloads/
3. Download Spark: https://spark.apache.org/downloads.html
Also check out similar informative videos in the field of cloud computing:
What is Big Data: https://www.seevid.ir/fa/w/-BoykjY5nKg
How Cloud Computing changed the world: https://www.seevid.ir/fa/w/lf2lQAyW2b4
What is Cloud? https://www.seevid.ir/fa/w/DeCMeA9Xm2g
Top 10 facts about Cloud Computing that will blow your mind! https://www.seevid.ir/fa/w/hmxNJEQ4XVY
Audience
This tutorial has been prepared for professionals/students aspiring to learn deep knowledge of Big Data Analytics using Apache Spark and become a Spark Developer and Data Engineer roles. In addition, it would be useful for Analytics Professionals and ETL developers as well.
Prerequisites
Before proceeding with this full course, it is good to have prior exposure to Python programming, database concepts, and any of the Linux operating system flavors.
-----------------------------------------------------------------------------------------------------------------------
Check out our full course topic wise playlist on some of the most popular technologies:
SQL Full Course Playlist-
• SQL Full Course
PYTHON Full Course Playlist-
• Python Full Course
Data Warehouse Playlist-
• Data Warehouse Full Course
Unix Shell Scripting Full Course Playlist-
• Unix Shell Scripting Full Course
-----------------------------------------------------------------------------------------------------------------------Don't forget to like and follow us on our social media accounts:
Facebook-
https://www.facebook.com/ampcode
Instagram-
https://www.instagram.com/ampcode_tutorials/
Twitter-
https://twitter.com/ampcodetutorial
Tumblr-
ampcode.tumblr.com
-----------------------------------------------------------------------------------------------------------------------
Channel Description-
AmpCode provides you e-learning platform with a mission of making education accessible to every student. AmpCode will provide you tutorials, full courses of some of the best technologies in the world today. By subscribing to this channel, you will never miss out on high quality videos on trending topics in the areas of Big Data & Hadoop, DevOps, Machine Learning, Artificial Intelligence, Angular, Data Science, Apache Spark, Python, Selenium, Tableau, AWS , Digital Marketing and many more.
#pyspark #bigdata #datascience #dataanalytics #datascientist #spark #dataengineering #apachespark #machinelearning
پارسال
در تاریخ 1402/04/05 منتشر شده
است.
1,163
بـار بازدید شده