Skip to content
  • Home
  • About
  • Write For US
|       { One stop for all Spark Examples }
Spark by {Examples}
  • Spark
    • Spark RDD
    • Spark DataFrame
    • Spark SQL Functions
    • What’s New in Spark 3.0?
    • Spark Streaming
    • Apache Spark Interview Questions
  • PySpark
  • Pandas
  • Hive
  • Kafka
  • H2O.ai
  • Interview Q
    • Spark Interview Questions
  • More
    • Apache Hadoop
    • Apache HBase
    • Apache Cassandra
    • Snowflake Database
    • H2O Sparkling Water
    • Scala Language
    • Python NumPy
    • R Language
Menu Close
  • Spark
    • Spark RDD
    • Spark DataFrame
    • Spark SQL Functions
    • What’s New in Spark 3.0?
    • Spark Streaming
    • Apache Spark Interview Questions
  • PySpark
  • Pandas
  • Hive
  • Kafka
  • H2O.ai
  • Interview Q
    • Spark Interview Questions
  • More
    • Apache Hadoop
    • Apache HBase
    • Apache Cassandra
    • Snowflake Database
    • H2O Sparkling Water
    • Scala Language
    • Python NumPy
    • R Language
  • Home
  • About
  • Write For US
Read more about the article Spark – Create a DataFrame with Array of Struct column
Apache Spark / Spark SQL Functions

Spark – Create a DataFrame with Array of Struct column

Problem: How to create a Spark DataFrame with Array of struct column using Spark and Scala? Using StructType and ArrayType classes we can create a DataFrame with Array of Struct…

0 Comments
October 30, 2019
Read more about the article Spark – Define DataFrame with Nested Array
Apache Spark / Spark SQL Functions

Spark – Define DataFrame with Nested Array

Problem: How to define Spark DataFrame using the nested array column (Array of Array)? Solution: Using StructType we can define an Array of Array (Nested Array) ArrayType(ArrayType(StringType)) DataFrame column using…

0 Comments
October 30, 2019
Read more about the article PySpark – explode nested array into rows
PySpark

PySpark – explode nested array into rows

Problem: How to explode & flatten nested array (Array of Array) DataFrame columns into rows using PySpark. Solution: PySpark explode function can be used to explode an Array of Array…

7 Comments
October 29, 2019
Read more about the article PySpark explode array and map columns to rows
PySpark

PySpark explode array and map columns to rows

In this article, I will explain how to explode array or list and map columns to rows using different PySpark DataFrame functions (explode, explore_outer, posexplode, posexplode_outer) with Python example. Before…

3 Comments
October 28, 2019
Read more about the article Spark – explode Array of Array (nested array) to rows
Apache Spark / Spark SQL Functions

Spark – explode Array of Array (nested array) to rows

Problem: How to explode & flatten the Array of Array (Nested Array) DataFrame columns into rows using Spark. Solution: Spark explode function can be used to explode an Array of…

2 Comments
October 20, 2019
Read more about the article Spark – explode Array of Map to rows
Apache Spark / Spark SQL Functions

Spark – explode Array of Map to rows

Problem: How to explode the Array of Map DataFrame columns to rows using Spark. Solution: Spark explode function can be used to explode an Array of Map ArrayType(MapType) columns to…

0 Comments
October 20, 2019
Read more about the article Spark – explode Array of Struct to rows
Apache Spark / Spark SQL Functions

Spark – explode Array of Struct to rows

Problem: How to explode Array of StructType DataFrame columns to rows using Spark. Solution: Spark explode function can be used to explode an Array of Struct ArrayType(StructType) columns to rows…

0 Comments
October 20, 2019
Read more about the article Spark explode array and map columns to rows
Apache Spark / Spark SQL Functions

Spark explode array and map columns to rows

In this article, I will explain how to explode array or list and map DataFrame columns to rows using different Spark explode functions (explode, explore_outer, posexplode, posexplode_outer) with Scala example.…

2 Comments
October 16, 2019

Categories

  • Apache Hadoop
  • Apache Spark
  • Apache Spark Streaming
  • Apache Kafka
  • Apache HBase
  • Apache Cassandra
  • Snowflake Database
  • H2O Sparkling Water
  • PySpark

Recent Posts

  • R Matrices Tutorial | Lean with Examples
  • R Vector Tutorial | Learn with Examples
  • Select Columns by Index Position in R
  • How to Select Columns by Name in R?
  • How to Select Columns in R?
  • R Data Frame Tutorial | Learn with Examples
  • R select() Function from dplyr – Usage with Examples
  • R Filter DataFrame by Column Value
  • slice() from dplyr in R – Examples
Privacy & Cookies: This site uses cookies. By continuing to use this website, you agree to their use.
To find out more, including how to control cookies, see here: Cookie Policy

About SparkByExamples.com

SparkByExamples.com is a Big Data and Spark examples community page, all examples are simple and easy to understand, and well tested in our development environment Read more ..
Copyright sparkbyexamples.com