SparkSession is an entry point to underlying Spark functionality in order to programmatically create Spark RDD, DataFrame and DataSet. It's object "spark" is default available in spark-shell and it can be created programmatically using SparkSession builder pattern.

Spark SQLContext is defined in org.apache.spark.sql package since 1.0 and is deprecated in 2.0 and replaced with SparkSession. SQLContext contains several useful functions of Spark SQL to work with structured data (columns & rows) and it is an entry point to Spark SQL.

SparkSession vs SQLContext

| *** Please Subscribe for Ad Free & Premium Content ***

Post author:Naveen Nelamali
Post category:Apache Spark / Member
Post last modified:April 25, 2024
Reading time:6 mins read

You are currently viewing SparkSession vs SQLContext

This content is for members only.
Join Now

Already a member? Log in here

Tags: SparkSession, SQLContext