Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Best Model and Evaluate Predictions
In this session, we will find out the best model and evaluate the predictions. This clip is from the chapter "Collaborative Filtering" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section primarily focuses...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Adding Invoke for Glue Job
In the session, we will invoke glue PySpark job from the Lambda function. This clip is from the chapter "Project - Change Data Capture / Replication Ongoing" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Spark DF with Column
In this session, we will see how we can manipulate the column values. This clip is from the chapter "Spark DFs" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section focuses on Spark DataFrames in depth.
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Why Big Data
This video provided you with an overview of the course. This clip is from the chapter "Introduction" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".Welcome to the course. This section introduces you to the course.
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Spark Infer Schema
In this lesson, you will learn about the schema of Spark DataFrames. This clip is from the chapter "Spark DFs" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section focuses on Spark DataFrames in depth.
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Spark DF (Group By -Visualization)
This video explains how grouping is happening by visualizing it for better understanding. This clip is from the chapter "Spark DFs" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section focuses on Spark...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Solution (Filter)
Let's discuss the solution for the quiz on Filter() function. This clip is from the chapter "Spark RDDs" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section focuses on PySpark RDDs.
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Project (Count and Select)
Let's start working on the project. We will first read data from the file in the DF followed by some analysis work. This clip is from the chapter "Spark DFs" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Hyperparameter Tuning and Cross Validation
In this video, you will learn about hyperparameter tuning and cross validation. This clip is from the chapter "Collaborative Filtering" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section primarily focuses...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Finding Min and Max
In this session, we will find the minimum and maximum movie ratings from the dataset. This clip is from the chapter "Spark RDDs" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section focuses on PySpark RDDs.
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Load data (Creating RDS-II)
Let's continue loading data (creating RDS) from the previous lesson. This clip is from the chapter "ETL Pipeline" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section covers Extract Transform Load (ETL)...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Finding Minimum and Maximum Marks
In this lesson, we will work on getting the minimum and maximum marks achieved per course. This clip is from the chapter "Spark RDDs" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section focuses on PySpark...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Solution (Word Count) - Spark DFs
Let's discuss the solution to the quiz on calculating the word count. This clip is from the chapter "Spark DFs" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section focuses on Spark DataFrames in depth.
Curated Video
Practical Data Science using Python - Machine Learning Terminology
This video explains machine learning terminology. This clip is from the chapter "Machine Learning" of the series "Practical Data Science Using Python".This section explains machine learning.
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Utility Matrix
Learn what utility matrix is with the help of an example. This clip is from the chapter "Collaborative Filtering" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section primarily focuses on collaborative...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Transforming Data
In this video, we will work on transforming the data. This clip is from the chapter "ETL Pipeline" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section covers Extract Transform Load (ETL) pipeline in depth.
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Total Students
In this session, we will work on the first steps of the mini project, which is showing the number of students in the file. This clip is from the chapter "Spark RDDs" of the series "PySpark and AWS: Master Big Data with PySpark and...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Running Spark Code Locally
In this session, we will replicate the code from the previous lesson to our local machine. This clip is from the chapter "Spark RDDs" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section focuses on PySpark...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Project Architecture
Let's go ahead and discuss the architecture of the entire project in this session. This clip is from the chapter "Project - Change Data Capture / Replication Ongoing" of the series "PySpark and AWS: Master Big Data with PySpark and...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Solution (Cache and Persist)
In this video, you will learn about the concepts of cache and persist. This clip is from the chapter "Spark DFs" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section focuses on Spark DataFrames in depth.
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Glue Job (Change Capture)
This video covers glue job (change capture). This clip is from the chapter "Project - Change Data Capture / Replication Ongoing" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section covers project work on...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Dataset
In this session, we will explore the dataset and put the dataset in the DBFS of Databricks and read the data. This clip is from the chapter "Collaborative Filtering" of the series "PySpark and AWS: Master Big Data with PySpark and...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Creating Spark DFs
Let's get started with Spark DataFrames. In this session, we will be creating the first DataFrames. This clip is from the chapter "Spark DFs" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section focuses on...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Collaborative Filtering
This video introduces you to collaborative filtering. This clip is from the chapter "Collaborative Filtering" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section primarily focuses on collaborative filtering...