Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Finding Min and Max
In this session, we will find the minimum and maximum movie ratings from the dataset. This clip is from the chapter "Spark RDDs" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section focuses on PySpark RDDs.
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Load data (Creating RDS-II)
Let's continue loading data (creating RDS) from the previous lesson. This clip is from the chapter "ETL Pipeline" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section covers Extract Transform Load (ETL)...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Finding Minimum and Maximum Marks
In this lesson, we will work on getting the minimum and maximum marks achieved per course. This clip is from the chapter "Spark RDDs" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section focuses on PySpark...
Curated Video
Elasticsearch 7 and Elastic Stack - In Depth and Hands On! - [Exercise] Importing Data with Spark
This video presents an exercise on importing data with Spark. This clip is from the chapter "Importing Data into Your Index (Big or Small)" of the series "Elasticsearch 7 and Elastic Stack - In Depth and Hands On".This section explains...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Utility Matrix
Learn what utility matrix is with the help of an example. This clip is from the chapter "Collaborative Filtering" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section primarily focuses on collaborative...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Transforming Data
In this video, we will work on transforming the data. This clip is from the chapter "ETL Pipeline" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section covers Extract Transform Load (ETL) pipeline in depth.
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Total Students
In this session, we will work on the first steps of the mini project, which is showing the number of students in the file. This clip is from the chapter "Spark RDDs" of the series "PySpark and AWS: Master Big Data with PySpark and...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Running Spark Code Locally
In this session, we will replicate the code from the previous lesson to our local machine. This clip is from the chapter "Spark RDDs" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section focuses on PySpark...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Project Architecture
Let's go ahead and discuss the architecture of the entire project in this session. This clip is from the chapter "Project - Change Data Capture / Replication Ongoing" of the series "PySpark and AWS: Master Big Data with PySpark and...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Solution (Cache and Persist)
In this video, you will learn about the concepts of cache and persist. This clip is from the chapter "Spark DFs" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section focuses on Spark DataFrames in depth.
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Glue Job (Change Capture)
This video covers glue job (change capture). This clip is from the chapter "Project - Change Data Capture / Replication Ongoing" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section covers project work on...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Dataset
In this session, we will explore the dataset and put the dataset in the DBFS of Databricks and read the data. This clip is from the chapter "Collaborative Filtering" of the series "PySpark and AWS: Master Big Data with PySpark and...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Creating Spark DFs
Let's get started with Spark DataFrames. In this session, we will be creating the first DataFrames. This clip is from the chapter "Spark DFs" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section focuses on...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Collaborative Filtering
This video introduces you to collaborative filtering. This clip is from the chapter "Collaborative Filtering" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section primarily focuses on collaborative filtering...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Applications of PySpark
Let's explore the in-demand applications of Spark in this session. This clip is from the chapter "Introduction" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".Welcome to the course. This section introduces you to...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Why Spark
In this lesson, you will learn why we need Spark and how it is useful. This clip is from the chapter "Introduction to Hadoop, Spark Ecosystems and Architectures" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Total Marks per Course
In this session, we will work on showing the total marks that the students have achieved per course. This clip is from the chapter "Spark RDDs" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section focuses on...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Spark DF (Group By - Multiple Columns and Aggregations)
In this session, you will learn about the grouping in multiple columns and then performing aggregations. This clip is from the chapter "Spark DFs" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section focuses...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Solution (Min and Max)
Let's discuss the solution for the quiz on finding the minimum and maximum from the given dataset. This clip is from the chapter "Spark RDDs" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section focuses on...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - RDD GroupByKey
In this lesson, we will take a look at the grouping transformation using the GroupByKey(). GroupByKey is used to create groups based on keys in RDD. This clip is from the chapter "Spark RDDs" of the series "PySpark and AWS: Master Big...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Finding Average-2
Let's continue calculating the average movie ratings from the dataset in this session as well. This clip is from the chapter "Spark RDDs" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section focuses on...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Quiz (Word Count) - Spark DFs
It's time for a short quiz on calculating the word count. This clip is from the chapter "Spark DFs" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section focuses on Spark DataFrames in depth.
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Project (Group By, Aggregations and Order By)
In this session, we will print the minimum and maximum salaries in each department and sort the salaries in ascending order. This clip is from the chapter "Spark DFs" of the series "PySpark and AWS: Master Big Data with PySpark and...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Expected Results
Let's discuss the expected results from the collaborative filtering in this session. This clip is from the chapter "Collaborative Filtering" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section primarily...