Freelance Apache Kafka Engineer / Streaming Specialist (m/f/d)

We are looking for a freelance Apache Kafka engineer / streaming specialist (m/f/d) for a customer project. The work is predominantly carried out remotely, with occasional on-site assignments at the customer's site. Tasks Design, construction and operation of Kafka clusters (self-managed and/or Confluent Cloud / MSK) Conception and implementation of event streaming and event-driven architectures Development and optimization of producers, consumers and stream processing pipelines (Kafka Streams / ksqlDB / Flink) Connection of source and target systems via Kafka Connect (source/sink connectors) Ensuring performance, Scalability, high availability and fault tolerance Monitoring, alerting and troubleshooting (e.g.

Prometheus, Grafana, Confluent Control Center) Establishment of best practices for topic design, partitioning, schema management and data governance Knowledge transfer and enablement of the internal team

Qualifications

Several years of demonstrable experience with Apache Kafka in production environments Deep understanding of Kafka internals (brokers, partitions, replication, consumer groups, Offsets, ISR) Practice with Kafka Connect and the Confluent ecosystem Experience with stream processing (Kafka Streams, ksqlDB or Apache Flink) Schema management with Schema Registry (Avro / Protobuf / JSON Schema) Sound programming knowledge (Java, Scala and/or Python) Experience with cloud platforms (AWS MSK, Confluent Cloud, Azure Event Hubs or similar) In addition, you ideally have: Confluent certification (CCDAK / CCAAK) Experience with Kubernetes and containerization (e.g. Strimzi Operator) Knowledge of Infrastructure as Code (Terraform, Ansible) Security experience (mTLS, SASL, ACLs, RBAC) Experience in projects within the transport and logistics industry Framework conditions Availability: within approx Travel to the Allgäu) Language: German (at least C1) / English (at least B2) Daily rate All-In: by arrangement Have we aroused your interest in our project? Then I look forward to hearing from you.

Please send me your current profile/CV including your availability and daily rate expectations. Find Jobs in Germany on Arbeitnow