Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Spark DF (Sort, OrderBy)
In this lesson, we will explore sorting in Spark DataFrame using sort and orderBy. This clip is from the chapter "Spark DFs" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section focuses on Spark DataFrames...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Spark DF (Group By - Filtering)
Let's explore filtering for group by in this video. This clip is from the chapter "Spark DFs" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section focuses on Spark DataFrames in depth.
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Solution (Average)
Let's discuss a solution for the quiz on average. This clip is from the chapter "Spark RDDs" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section focuses on PySpark RDDs.
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Select DF Columns
Learn how to select multiple columns from the DataFrames. This clip is from the chapter "Spark DFs" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section focuses on Spark DataFrames in depth.
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - RDD Distinct
In this lesson, you will learn about the Distinct() RDD function. This clip is from the chapter "Spark RDDs" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section focuses on PySpark RDDs.
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - RDD (saveAsTextFile)
In this session, you will learn about how to save RDD to a text file using the saveAsTextFile() function. This clip is from the chapter "Spark RDDs" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - RDD (Partition)
In this lesson, we will explore the concepts of partition. This clip is from the chapter "Spark RDDs" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section focuses on PySpark RDDs.
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Quiz (UDFs)
It's time for a short quiz on UDFs. This clip is from the chapter "Spark DFs" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section focuses on Spark DataFrames in depth.
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Change Data Capture Pipeline
In this lesson, we will perform the last step of the project, which is the Change Data Capture (CDC) pipeline. Let's wind up. This clip is from the chapter "Project - Change Data Capture / Replication Ongoing" of the series "PySpark and...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Running Spark
In this session, we will run Spark and confirm if it was configured successfully. This clip is from the chapter "Introduction to Hadoop, Spark Ecosystems and Architectures" of the series "PySpark and AWS: Master Big Data with PySpark and...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - RDS Networking
Now that our database is ready, we will go ahead and work on RDS networking. This clip is from the chapter "ETL Pipeline" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section covers Extract Transform Load...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Quiz (Word Count) - Spark RDDs
It's time for a short quiz on word count. This clip is from the chapter "Spark RDDs" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section focuses on PySpark RDDs.
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Quiz (Min and Max)
It's time for a short quiz on finding the minimum and maximum from the given dataset. This clip is from the chapter "Spark RDDs" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section focuses on PySpark RDDs.
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Quiz (Map)
It's time for a short quiz on Map() function. This clip is from the chapter "Spark RDDs" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section focuses on PySpark RDDs.
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Projects Overview
This video provides a brief description of the various projects we will be building together. This clip is from the chapter "Introduction" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".Welcome to the course. This...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Introduction to Project
This video provides an overview of the entire project work. This clip is from the chapter "Project - Change Data Capture / Replication Ongoing" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section covers...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Getting S3 File Name in Lambda
In this session, we will try to get the S3 file name in Lambda. This clip is from the chapter "Project - Change Data Capture / Replication Ongoing" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section covers...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Creating Lambda Function and Adding Trigger
This video covers creating Lambda and adding triggers. This clip is from the chapter "Project - Change Data Capture / Replication Ongoing" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section covers project...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Create DF from RDD
In this video, you will learn how to create a DataFrames from RDD. This clip is from the chapter "Spark DFs" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section focuses on Spark DataFrames in depth.
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Create Databricks Notebook
Learn how create your first Databricks notebook. This clip is from the chapter "Introduction to Hadoop, Spark Ecosystems and Architectures" of the series "PySpark and AWS: Master Big Data with PySpark and AWS".This section primarily...
Curated Video
PySpark and AWS: Master Big Data with PySpark and AWS - Average Marks per Course
In this lesson, we will work on the next step, which is to show the average marks that students have achieved per course. This clip is from the chapter "Spark RDDs" of the series "PySpark and AWS: Master Big Data with PySpark and...
Curated Video
Snowflake - Build and Architect Data Pipelines Using AWS - What Is Row Level Security?
This video explains about row level security. This clip is from the chapter "Snowflake – Data Protection and Governance" of the series "Snowflake - Build and Architect Data Pipelines Using AWS".This section focuses on data protection and...
Curated Video
Snowflake - Build and Architect Data Pipelines Using AWS - Lab – Micro-Partitions and Clustering Keys
This video explains micro-partitions and clustering keys. This clip is from the chapter "Snowflake – Partitioning, Clustering, and Performance Optimization" of the series "Snowflake - Build and Architect Data Pipelines Using AWS".This...
Curated Video
Elasticsearch 7 and Elastic Stack - In Depth and Hands On! - Elasticsearch and Apache Spark - Part 1
This is the first part of the two-part video that explains Elasticsearch and Apache Spark. This clip is from the chapter "Importing Data into Your Index (Big or Small)" of the series "Elasticsearch 7 and Elastic Stack - In Depth and...