ALTER Column Data Type in AWS Redshift
Alter command doesn't support changing the column data type in Amazon AWS Redshift hence, you need to create a new column with the desired data type, copy the data from…
0 Comments
April 7, 2023
ALTER the Length of a varchar Column in Redshift
To ALTER or change the length/size of a column in Amazon AWS Redshift use the ALTER COLUMN column_name TYPE clause in ALTER TABLE SQL statement. This TYPE clause in ALTER…
April 3, 2023
Spark Read Json From Amazon S3
Using Spark SQL spark.read.json("path") you can read a JSON file from Amazon S3 bucket, HDFS, Local file system, and many other file systems supported by Spark. Similarly using write.json("path") method…
February 17, 2021
Photo by Nemichandra Hombannavar on Unsplash
Spark Read Text File from AWS S3 bucket
In this Spark sparkContext.textFile() and sparkContext.wholeTextFiles() methods to use to read test file from Amazon AWS S3 into RDD and spark.read.text() and spark.read.textFile() methods to read from Amazon AWS S3…
March 20, 2020
Photo by Lewis Ngugi on Unsplash
Write & Read CSV file from S3 into DataFrame
Spark SQL provides spark.read.csv("path") to read a CSV file from Amazon S3, local file system, hdfs, and many other data sources into Spark DataFrame and dataframe.write.csv("path") to save or write…
March 19, 2020
Spark – Read & Write Avro files from Amazon S3
In this Spark tutorial, you will learn what is Avro format, It’s advantages and how to read the Avro file from Amazon S3 bucket into Dataframe and write DataFrame in…
March 16, 2020
Read and Write Parquet file from Amazon S3
Spark read from & write to parquet file | Amazon S3 bucket In this Spark tutorial, you will learn what is Apache Parquet, It's advantages and how to read the…
March 14, 2020
