Skip to content
  • Home
  • About
|         *** Please Subscribe for Ad Free & Premium Content ***
Spark By {Examples}
  • Connect
  •   | 
  • Join for Ad Free
  • Spark
    • Spark Introduction
    • Spark RDD Tutorial
    • Spark SQL Functions
    • What’s New in Spark 3.0?
    • Spark Streaming
    • Apache Spark on AWS
    • Apache Spark Interview Questions
  • PySpark
  • Pandas
  • R
    • R Programming
    • R Data Frame
    • R dplyr Tutorial
    • R Vector
  • Hive
  • FAQ
    • Spark Interview Questions
  • Tutorials
    • Snowflake
    • H2O.ai
    • AWS
    • Apache Kafka Tutorials with Examples
    • Apache Hadoop Tutorials with Examples :
    • NumPy
    • Apache HBase
    • Apache Cassandra Tutorials with Examples
    • H2O Sparkling Water
  • Log In
  • Toggle website search
Menu Close
  • Spark
    • Spark Introduction
    • Spark RDD Tutorial
    • Spark SQL Functions
    • What’s New in Spark 3.0?
    • Spark Streaming
    • Apache Spark on AWS
    • Apache Spark Interview Questions
  • PySpark
  • Pandas
  • R
    • R Programming
    • R Data Frame
    • R dplyr Tutorial
    • R Vector
  • Hive
  • FAQ
    • Spark Interview Questions
  • Tutorials
    • Snowflake
    • H2O.ai
    • AWS
    • Apache Kafka Tutorials with Examples
    • Apache Hadoop Tutorials with Examples :
    • NumPy
    • Apache HBase
    • Apache Cassandra Tutorials with Examples
    • H2O Sparkling Water
  • Log In
  • Toggle website search
  • Home
  • About

kafka consumer

Home » kafka consumer
Read more about the article Spark Streaming – Kafka messages in Avro format
Apache Kafka / Apache Spark / Apache Spark Streaming

Spark Streaming – Kafka messages in Avro format

This article describes Spark Structured Streaming from Kafka in Avro file format and usage of…

7 Comments
March 23, 2019
Read more about the article Spark Streaming with Kafka Example
Apache Spark / Apache Spark Streaming / Member

Spark Streaming with Kafka Example

Spark Streaming with Kafka Example Using Spark Streaming we can read from Kafka topic and…

2 Comments
March 17, 2019
Read more about the article Spark SQL Batch Processing – Produce and Consume Apache Kafka Topic
Apache Kafka / Apache Spark

Spark SQL Batch Processing – Produce and Consume Apache Kafka Topic

This article describes Spark Batch Processing using Kafka Data Source. Unlike Spark structure stream processing, we may need to process batch jobs which reads the data from Kafka and writes the data to Kafka topic in batch mode. To do this we should use read instead of resdStream similarly write instead of writeStream on DataFrame

1 Comment
March 11, 2019
Read more about the article Kafka consumer and producer example with a custom serializer
Apache Kafka

Kafka consumer and producer example with a custom serializer

Kafka allows us to create our own serializer and deserializer so that we can produce and consume different data types like Json, POJO e.t.c. In this post will see how to produce and consumer User pojo object. To stream pojo objects one need to create custom serializer and deserializer.

1 Comment
January 4, 2019
Read more about the article Apache Kafka Producer and Consumer in Scala
Apache Kafka

Apache Kafka Producer and Consumer in Scala

This article explains how to write Kafka Producer and Consumer example in Scala. Producer sends messages to Kafka topics in the form of records, a record is a key-value pair along with topic name and consumer receives a messages from a topic.

7 Comments
January 4, 2019

LOGIN for Tutorial Menu

  • Log In

Top Tutorials

  • Apache Spark Tutorial
  • PySpark Tutorial
  • Python Pandas Tutorial
  • R Programming Tutorial
  • Python NumPy Tutorial
  • Apache Hive Tutorial
  • Apache HBase Tutorial
  • Apache Cassandra Tutorial
  • Apache Kafka Tutorial
  • Snowflake Data Warehouse Tutorial
  • H2O Sparkling Water Tutorial

Categories

  • Apache Spark
  • PySpark
  • Pandas
  • R Programming
  • Snowflake Database
  • NumPy
  • Apache Hive
  • Apache HBase
  • Apache Kafka
  • Apache Cassandra
  • H2O Sparkling Water

Legal

  • SparkByExamples.com – Privacy Policy
  • Refund Policy
  • Terms of Use
  • Opens in a new tab
  • Opens in a new tab
  • Opens in a new tab
  • Opens in a new tab
  • Opens in a new tab
Copyright 2024 www.SparkByExamples.com. All rights reserved.