Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Data Set
In this lesson, we will start working on the ETL pipeline. Let's get the dataset ready. This clip is from the chapter "ETL Pipeline" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section covers Extract...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - ALS Model
In this video, you will learn about ALS model. This clip is from the chapter "Collaborative Filtering" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section primarily focuses on collaborative filtering and...
Curated Video
Elasticsearch 7 and Elastic Stack - In Depth and Hands On! - Importing Data with a Script
This video explains how to import data with a script. This clip is from the chapter "Importing Data into Your Index (Big or Small)" of the series "Elasticsearch 7 and Elastic Stack - In Depth and Hands On".This section explains how to...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Spark Streaming DF Aggregations
In this session, we will see how to perform aggregations and display them. This clip is from the chapter "Spark Streaming" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".The section primarily focuses on Spark...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Spark DF (Spark SQL)
In this lesson, we will explore Spark SQL. This clip is from the chapter "Spark DFs" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section focuses on Spark DataFrames in depth.
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Spark DF (Count, Distinct, Duplicate)
In this session, you will learn about Count, Distinct, and Drop duplicates in DataFrame. This clip is from the chapter "Spark DFs" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section focuses on Spark...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Solution (UDFs)
Let's discuss the solution for the quiz on UDFs. This clip is from the chapter "Spark DFs" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section focuses on Spark DataFrames in depth.
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Loading Data (Creating RDS-I)
In this video, we will load the data to the destination, which is the database (creating RDS). This clip is from the chapter "ETL Pipeline" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section covers Extract...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Loading Data
Once we have successfully connected to RDS through PGAdmin, we can now create a schema and refer to the notebook, which consists of the word count as a result of the transformation. This clip is from the chapter "ETL Pipeline" of the...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Introduction to ETL
This session introduces you to the ETL pipeline. This clip is from the chapter "ETL Pipeline" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section covers Extract Transform Load (ETL) pipeline in depth.
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Rectifying the Error
In this session, we will rectify the errors we faced while creating DataFrames from RDD. This clip is from the chapter "Spark DFs" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section focuses on Spark...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - RDD Filter
In this lesson, you will learn about Filter() function. This clip is from the chapter "Spark RDDs" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section focuses on PySpark RDDs.
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Quiz (Sort, OrderBy)
It's time for a short quiz on sorting. This clip is from the chapter "Spark DFs" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section focuses on Spark DataFrames in depth.
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Quiz (Average)
It's time for a short quiz on average. This clip is from the chapter "Spark RDDs" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section focuses on PySpark RDDs.
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Project (Filtering)
In this lesson, we will print the names of employees working in NY state under finance department whose bonuses are greater than the average bonuses of employees in NY state. This clip is from the chapter "Spark DFs" of the series...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Glue Job (Full Load)
This video covers how to use the right glue job (full load). This clip is from the chapter "Project - Change Data Capture / Replication Ongoing" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section covers...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - ETL Pipeline Flow
In this video, we will discuss the pipeline we will be working on. This clip is from the chapter "ETL Pipeline" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section covers Extract Transform Load (ETL)...
Curated Video
Snowflake - Build and Architect Data Pipelines Using AWS - Section Overview - Snowflake – Partitioning, Clustering, and Performance Optimization
This video provides an overview of the section. This clip is from the chapter "Snowflake – Partitioning, Clustering, and Performance Optimization" of the series "Snowflake - Build and Architect Data Pipelines Using AWS".This section...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Total Enrollments per Course
In this lesson, we will work on the 4th step, which is to show the total number of students enrolled per course. This clip is from the chapter "Spark RDDs" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Spark Streaming Reading Data
In this session, you will read data from file and get it in the Spark streaming context. This clip is from the chapter "Spark Streaming" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".The section primarily focuses...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Spark Streaming Display
In this lesson, we will work on Spark streaming display for better data visualization. This clip is from the chapter "Spark Streaming" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".The section primarily focuses on...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Spark Streaming Context
In this video, you will learn how to read data and specify the directory in the Spark streaming context with RDD. This clip is from the chapter "Spark Streaming" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".The...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Spark RDDs
Learn about spark RDDs (Resilient Distributed Dataset) in this session. This clip is from the chapter "Spark RDDs" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section focuses on PySpark RDDs.
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Spark DF with Column Renamed and Alias
In this video, we will learn how we can rename the column in Spark DataFrames. This clip is from the chapter "Spark DFs" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section focuses on Spark DataFrames in...