Spark Streaming with Kafka Example
Spark Streaming with Kafka Example Using Spark Streaming we can read from Kafka topic and write to Kafka topic in TEXT, CSV, AVRO and JSON formats, In this article, we…
1 Comment
March 17, 2019
Spark Streaming – Different Output modes explained
This article describes usage and differences between complete, append and update output modes in Apache Spark Streaming. outputMode describes what data is written to a data sink (console, Kafka e.t.c) when there is new data available in streaming input (Kafka, Socket, e.t.c)
March 17, 2019
Spark Streaming – Reading data from TCP Socket
Using Spark streaming we will see a working example of how to read data from TCP Socket, process it and write output to console. Spark uses readStream() to read and…
March 16, 2019
Spark Streaming files from a directory
This article describes and provides an example of how to continuously stream or read a JSON file source from a folder, process it and write the data to another source
March 16, 2019