Photo by Nemichandra Hombannavar on Unsplash

Spark Read Text File from AWS S3 bucket

In this Spark sparkContext.textFile() and sparkContext.wholeTextFiles() methods to use to read test file from Amazon AWS S3 into RDD and spark.read.text() and spark.read.textFile() methods to read from Amazon AWS S3…

0 Comments

March 20, 2020

Read more about the article Spark Read Text File | RDD | DataFrame

Photo by Nemichandra Hombannavar on Unsplash

Apache Spark

Spark Read Text File | RDD | DataFrame

In this Spark tutorial, you will learn how to read a text file from local & Hadoop HDFS into RDD and DataFrame using Scala examples. Spark provides several ways to…

2 Comments

December 19, 2019