Kafka


Reading time: less than 1 minute

Apache Kafka is an open-source distributed event streaming platform used for building real-time data pipelines and streaming applications. It is designed to handle high volumes of data with low latency and high throughput.

Kafka CLI tools

Kaf

birdays/kaf is a self-contained tool written in Golang.

  • It is able to use mTLS to authenticate the client to the Kafka brokers using client certificates.

Other tools

  • https://github.com/edenhill/kcat

Client libraries

  • https://github.com/confluentinc/librdkafka

Using Kafka with ClickHouse

ClickHouse has built-in integrations to fetch data from Kafka.

  • https://clickhouse.com/docs/en/integrations/kafka/kafka-table-engine
  • https://altinity.com/blog/clickhouse-kafka-engine-faq
  • https://clickhouse.com/docs/en/integrations/kafka
  • https://github.com/ClickHouse/ClickHouse/issues/30989

Citation

If you find this work useful, please cite it as:
@article{yaltirakli,
  title   = "Kafka",
  author  = "Yaltirakli, Gokberk",
  journal = "gkbrk.com",
  year    = "2024",
  url     = "https://www.gkbrk.com/kafka"
}
Not using BibTeX? Click here for more citation styles.
IEEE Citation
Gokberk Yaltirakli, "Kafka", November, 2024. [Online]. Available: https://www.gkbrk.com/kafka. [Accessed Nov. 12, 2024].
APA Style
Yaltirakli, G. (2024, November 12). Kafka. https://www.gkbrk.com/kafka
Bluebook Style
Gokberk Yaltirakli, Kafka, GKBRK.COM (Nov. 12, 2024), https://www.gkbrk.com/kafka

Comments

© 2024 Gokberk Yaltirakli