Apache Kafka is an open-source distributed event streaming platform used for building real-time data pipelines and streaming applications. It is designed to handle high volumes of data with low latency and high throughput.
Kafka CLI tools
Kaf
birdays/kaf is a self-contained tool written in Golang.
- It is able to use mTLS to authenticate the client to the Kafka brokers using client certificates.
Other tools
- https://github.com/edenhill/kcat
Client libraries
- https://github.com/confluentinc/librdkafka
Using Kafka with ClickHouse
ClickHouse has built-in integrations to fetch data from Kafka.
- https://clickhouse.com/docs/en/integrations/kafka/kafka-table-engine
- https://altinity.com/blog/clickhouse-kafka-engine-faq
- https://clickhouse.com/docs/en/integrations/kafka
- https://github.com/ClickHouse/ClickHouse/issues/30989
