Job summary:


Title:
Kafka Architect -Remote

Location:
Remote

Length and terms:
Long term - W2 or C2C


Position created on 05/29/2025 09:06 pm

Job description:


**** Webcam interview;  *** Long term project *** Remote ***

Key Responsibilties 

  • Architect and implement real-time event streaming platforms for use cases such as real-time inventory tracking, fraud detection, personalized promotions, and dynamic pricing.
  • Evaluate and select Kafka deployment models (self-managed, Confluent, AWS MSK, Azure Event Hubs, etc.) based on business and scalability needs.
  • Design high-availability Kafka clusters to handle massive transaction volumes in eCommerce, POS systems, and digital customer engagement.
  • Define best practices for topic management, schema evolution (Schema Registry), and partitioning strategies for large-scale retail data flows.
  • Enable real-time customer data streaming from multiple sources (POS, eCommerce platforms, loyalty programs, IoT devices).
  • Build Kafka-powered data pipelines to integrate with ERP, CRM, WMS, OMS, and personalization engines.
  • Develop stream processing solutions using Kafka Streams and ksqlDB for dynamic promotions, order fulfillment, and fraud detection.
  • Ensure seamless integration with retail analytics platforms like Snowflake, Databricks, and Google BigQuery.
  • Optimize Kafka infrastructure to support seasonal peaks, high traffic surges (e.g., Black Friday, Cyber Monday), and multi-channel order management.
  • Implement disaster recovery, failover strategies, and high-availability configurations for mission-critical retail systems.
  • Define security policies for data protection, compliance (PCI-DSS), and customer privacy regulations (GDPR, CCPA).
  • Establish monitoring, logging, and alerting using tools like Prometheus, Grafana, Splunk, and Open Telemetry.
  • Act as the Kafka SME for retail transformation projects, educating engineering and business teams on event-driven capabilities.
  • Collaborate with eCommerce, supply chain, marketing, and data science teams to drive real-time decision-making.
  • Partner with cloud architects, DevOps, and cybersecurity teams to ensure a secure, scalable Kafka ecosystem.

Required Skills

  • 14+ years of experience in designing and implementing event-driven architectures, preferably in retail, eCommerce, or omnichannel environments.
  • Deep expertise in Apache Kafka (Kafka Streams, Kafka Connect, ksqlDB, Schema Registry).
  • Strong knowledge of real-time retail analytics, demand forecasting, and digital customer engagement.
  • Experience integrating Kafka with retail POS systems, inventory management, and order fulfillment platforms.
  • Hands-on experience with microservices and event-driven patterns (CQRS, SAGA, Event Sourcing).
  • Experience working with cloud-based Kafka implementations (AWS MSK, Azure Event Hubs, GCP Pub/Sub).
  • Proficiency in real-time inventory tracking, recommendation engines, and fraud detection systems.
  • Experience with containerization (Docker, Kubernetes) and CI/CD pipelines for Kafka deployments.
  • Strong background in monitoring tools and performance tuning for Kafka clusters

Contact the recruiter working on this position:



The recruiter working on this position is Mahesh Kodur(Raghu team)
His/her contact number is
His/her contact email is kmahesh@msysinc.com

Our recruiters will be more than happy to help you to get this contract.