PySpark Convert String to Array Column

Post author:NNK
Post category:PySpark

PySpark SQL provides split() function to convert delimiter separated String to an Array (StringType to ArrayType) column on DataFrame. This can be done by splitting a string column based on a delimiter like space, comma, pipe e.t.c, and converting it into ArrayType. In this article, I will explain converting String…

Spark split() function to convert string to Array column

Post author:NNK
Post category:Apache Spark Spark SQL Functions

Spark SQL provides split() function to convert delimiter separated String to array (StringType to ArrayType) column on Dataframe. This can be done by splitting a string column based on a delimiter like space, comma, pipe e.t.c, and converting into ArrayType. In this article, I will explain split() function syntax and…