Manipulating String Columns in Dataframe
Manipulating String columns in Dataframe
In this video we will understand how to manipulate the String columns in Dataframe. For the demo we are using Spark 2.4 version and scala language.
Working with AVRO data
Working with AVRO data in Apache Spark
In this video we will understand how to work with AVRO data in Apache Spark.For the demo we are using Spark 2.4 version and scala language.
Working with CSV data in Apache Spark
Working with CSV data in Apache Spark
In this video we will understand how to work with CSV data in Apache Spark. For the demo we are using Spark 2.4 version and scala language.
Working with Dataframe columns in Spark
Working with DataFrame Columns in Apache Spark
In this video we will understand how to work with DataFrame Columns in Apache Spark.
Working with Hive Metastore in Spark
Working With Hive Metastore in Apache Spark
In this lecture we will learn how to work with Hive Metastore in Apache Spark. We will be reading table from Hive metasotre in spark and will also be creating a table using saveAsTable API.
Working with JSON data
Working with JSON data in Apache Spark
In this video we will learn how to work with JSON data in Apache Spark.
Working with Parquet Data
Working with Parquet File Format in Spark
In this lecture we will learn how to work with Parquet File Format in Spark.
Manipulating Dates in Apache Spark DataFrame
Manipulating Dates in Dataframe using Spark API
Manipulating Dates in Dataframe using Spark API using from_unixtime(), unix_timestamp(), to_date(), hour(), minute() and second() function.
Understanding DataFrame abstraction in Apache Spark
In this video we will understand DataFrame abstraction in Spark.