Member-only story

Kafka — Introduction Part 1

Bala
2 min readApr 15, 2020

--

In this blog, I will be discussing data stream processing Tool Kafka and it’s history. In the coming blog, we get in detail about how to use Kafka, how to code in Kafka and how to build a Kafka producer, consumer, and topic.

Apache Kafka as a stream processing tool

  • Kafka is easy to use and the most popular streaming data platform in the industry. It uses log-structured storage for a message queue.
  • Logs of events in Kafka and it is fault-tolerant
  • Kafka is a distributed system and which can be called up very easily.
  • It provides ordering guarantees i.e., data received is the order data will be produced.
  • Other commonly used data streaming tools are Apache Spark, Flink, and Samza.

Kafka History

  • Kafka originally creaked by LinkedIn to service internal stream processing needs. Now Kafka owner has created his own company called confluent which is Charles all the Kafka projects.
  • Companies like Uber, Apple and Airbnb used Kafka for their data streaming.
  • Industry Case studies:

https://eng.uber.com/tech-stack-part-one-foundation/

--

--

Bala
Bala

Written by Bala

Technical Lead @ Pharma Industry

No responses yet