-
Big Data with Apache Spark: Deduplication
After watching this video, you will be able to implement deduplication with and without watermarking.
-
Big Data with Apache Spark: Continuous Applications
After watching this video, you will be able to describe continuous applications in terms of structured streaming.
-
Big Data with Apache Spark: Windowing
After watching this video, you will be able to apply window operations on event time.
-
Big Data with Apache Spark: Stream Output
After watching this video, you will be able to write stream data using writeStream.
-
Big Data with Apache Spark: Streaming Query Manager
After watching this video, you will be able to manage streaming queries.
-
Big Data with Apache Spark: Streaming Query
After watching this video, you will be able to use streaming query objects.
-
Big Data with Apache Spark: File Sinks
After watching this video, you will be able to store stream output to a directory using a file sink.
-
Big Data with Apache Spark: Environment Configuration
After watching this video, you will be able to use the Spark environment configuration parameters.
-
Big Data with Apache Spark: Web UI
After watching this video, you will be able to access the web user interface.
-
Big Data with Apache Spark: Word Count
After watching this video, you will be able to use structured streaming to implement a word count on a text stream.
-
Big Data with Apache Spark: Checkpointing
After watching this video, you will be able to enable checkpointing in structured streaming.
-
Big Data with Apache Spark: Speculation
After watching this video, you will be able to modify speculation controls for Spark tasks.
-
Big Data with Apache Spark: Memory Allocation
After watching this video, you will be able to set JVM fractional memory amounts for Spark.
-
Big Data with Apache Spark: REST API
After watching this video, you will be able to use JSON to query monitoring tools for Spark.
-
Big Data with Apache Spark: Identify Spark Streaming Basics
After watching this video, you will be able to describe the basics of Spark Streaming.
-
Big Data with Apache Spark: Memory Tuning
After watching this video, you will be able to describe memory management and consumption.
-
Big Data with Apache Spark: Serialization
After watching this video, you will be able to describe data serialization and the role it plays in the performance of Spark applications.
-
Big Data with Apache Spark: Downloading and Installing Apache Spark on Mac OS
After watching this video, you will be able to download and install Apache Spark 2.2 on Mac OS.
-
Big Data with Apache Spark: Downloading and Installing Apache Spark
After watching this video, you will be able to download and install Apache Spark 2.2.
-
Big Data with Apache Spark: Overview of Apache Spark
After watching this video, you will be able to describe Apache Spark 2.2 and the main components of a Spark application.
-
Big Data with Apache Spark: Working with Spark Shell
After watching this video, you will be able to use Spark shell for analyzing data interactively.
-
Big Data with Apache Spark: Building Spark
After watching this video, you will be able to build Apache Spark using Apache Maven.
-
Big Data with Apache Spark: Linking to Spark
After watching this video, you will be able to link an application to Spark.
-
Big Data with Apache Spark: Use Apache Spark Shell
After watching this video, you will be able to use Apache Spark shell.
-
Big Data with Apache Spark: Running Spark on Clusters
After watching this video, you will be able to describe how Spark runs on clusters and the three supported cluster managers.
-
Big Data with Apache Spark: Initializing Apache Spark
After watching this video, you will be able to create a SparkContext to initialize Apache Spark.
-
Big Data with Apache Spark: Spark Configuration
After watching this video, you will be able to identify the three locations Spark provides to configure the system.
-
Big Data with Apache Spark: Aggregations
After watching this video, you will be able to use aggregations with the built-in DataFrames functions.
-
Big Data with Apache Spark: DataFrames
After watching this video, you will be able to create DataFrames with Spark SQL.
-
Big Data with Apache Spark: SparkSession
After watching this video, you will be able to create a SparkSession.
-
Big Data with Apache Spark: Apache Spark SQL Overview
After watching this video, you will be able to describe Apache Spark SQL.
-
Big Data with Apache Spark: SQL Queries
After watching this video, you will be able to run SQL queries programmatically.
-
Big Data with Apache Spark: Datasets
After watching this video, you will be able to create Datasets with Spark SQL.
-
Big Data with Apache Spark: Temporary View
After watching this video, you will be able to create a global temporary view.
-
Big Data with Apache Spark: Querying with SQL
After watching this video, you will be able to run SQL directly on files.
-
Big Data with Apache Spark: Specifying a Data Source
After watching this video, you will be able to manually specify a data source.
-
Big Data with Apache Spark: Load/Save Functions
After watching this video, you will be able to use Load/Save functions.
-
Big Data with Apache Spark: JSON Datasets
After watching this video, you will be able to use JSON Datasets with Spark SQL.
-
Big Data with Apache Spark: Persistent Tables
After watching this video, you will be able to use Spark SQL to save a DataFrame as a persistent table.
-
Big Data with Apache Spark: Parquet Files
After watching this video, you will be able to write parquet files with Spark SQL.
-
Big Data with Apache Spark: SaveMode
After watching this video, you will be able to use SaveMode to handle save operations.
-
Big Data with Apache Spark: Use Spark SQL
After watching this video, you will be able to use Spark SQL to create Datasets and DataFrames.
-
Big Data with Apache Spark: Stream Input
After watching this video, you will be able to read stream input using readStream.
-
Big Data with Apache Spark: Structured Streaming Overview
After watching this video, you will be able to describe Structured Streaming.
-
Big Data with Apache Spark: Partitioning
After watching this video, you will be able to use partitioning when saving persistent tables.
-
Big Data with Apache Spark: Garbage Collection Tuning
After watching this video, you will be able to describe garbage collection tuning.
-
Big Data with Apache Spark: Executor Memory
After watching this video, you will be able to determine executor memory allocation.
-
Big Data with Apache Spark: Data Compression
After watching this video, you will be able to implement data compression on parquet storage.
-
Big Data with Apache Spark: Explain Query Execution
After watching this video, you will be able to use query execution plan explainer.
-
Big Data with Apache Spark: Broadcast Functionality
After watching this video, you will be able to use the broadcast functionality.
-
Big Data with Apache Spark: Parallelism
After watching this video, you will be able to set the level of parallelism.
-
Big Data with Apache Spark: SSL Settings
After watching this video, you will be able to configure the SSL settings.
-
Big Data with Apache Spark: Secure Event Logs
After watching this video, you will be able to set permissions on the directory where the event logs are stored.
-
Big Data with Apache Spark: Spark UI
After watching this video, you will be able to secure the Spark UI by limiting access using a firewall.
-
Big Data with Apache Spark: SASL Encryption
After watching this video, you will be able to enable SASL encryption for a Spark application.
-
Big Data with Apache Spark: YARN Deployments
After watching this video, you will be able to configure spark.authenticate.
-
Big Data with Apache Spark: Shared Secret
After watching this video, you will be able to configure a shared secret for Spark authentication.
-
Big Data with Apache Spark: Configure Spark Security
After watching this video, you will be able to configure Spark security.
-
Big Data with Apache Spark: Network Security
After watching this video, you will be able to configure the primary ports Spark uses for communication.