Apache Kafka is an open-source distributed event streaming platform used for building real-time data pipelines and streaming applications. It is designed to handle high volumes of data with low latency and high throughput.

Kafka CLI tools


birdays/kaf is a self-contained tool written in Golang.

  • It is able to use mTLS to authenticate the client to the Kafka brokers using client certificates.

Other tools

  • https://github.com/edenhill/kcat

Client libraries

  • https://github.com/confluentinc/librdkafka

Using Kafka with ClickHouse

ClickHouse has built-in integrations to fetch data from Kafka.

  • https://clickhouse.com/docs/en/integrations/kafka/kafka-table-engine
  • https://altinity.com/blog/clickhouse-kafka-engine-faq
  • https://clickhouse.com/docs/en/integrations/kafka
  • https://github.com/ClickHouse/ClickHouse/issues/30989